Blog

Learn about Apache Iceberg, data lakehouses, ingestion, industry trends, architecture, strategies, and more.

Upsolver News

• Upsolver Announces Support for Polaris Catalog

• Upsolver Announces Iceberg Table Mirroring to Snowflake

• Deliver Data to ClickHouse Cloud 100x Faster with Upsolver

• Upsolver Named Data Movement Partner by PuppyGraph

• Upsolver Announces Zero-ETL and lakehouse Optimization for Apache Iceberg

• Data Ingestion Solutions Review: 11 Key Takeaways

• Announcing: Upsolver joins the Connect with Confluent (CwC) Program

• A Scalable Way to Deliver NoSQL Prod Data to Analytics Environments

• Upsolver Announces Support for AWS for Advertising and Marketing Initiative

Data Lakes & Lakehouses

• Simplifying Iceberg Table Partitioning Using Adaptive Clustering

• Effortless Table Management with Adaptive Optimizer for Iceberg: Boost Performance & Cut Costs

• Simplifying Iceberg Table Partitioning Using Adaptive Clustering

• An Introduction to Polaris Catalog for Apache Iceberg

• Optimizing Your Data Lakehouse for Cost Efficiency

• Iceberg Performance Benchmarks: Tabular, Snowflake, AWS Glue and Upsolver Compared

• The Iceberg Data Lakehouse Stack: Choose the Right Building Blocks

• Cut Data Warehouse Costs in Half with Apache Iceberg

• Iceberg 101: A Guide to Iceberg Partitioning

• Iceberg 101: Ten Tips to Optimize Performance

• Iceberg 101: Working with Iceberg Tables

• Iceberg 101: Better Data Lakes with Apache Iceberg

• Iceberg 101: What is the Iceberg Table Format?

• An Introduction to the Data Lakehouse for Data Warehouse Users

• Ingesting Operational Data into an Analytics Lakehouse on Iceberg

• Iceberg Architecture Examples: How Iceberg Powers Data and ML Applications at Adobe, Netflix, LinkedIn, Salesforce, and Airbnb

• Lakehouse vs. Data Lake: The Ultimate Guide

• How Apache Iceberg is Reshaping Data Lake File Management

• Apache Iceberg vs Parquet – File Formats vs Table Formats

• Moving data from a lake to Snowflake

• Migrating a Self-Managed Data Lake to Snowflake

• Why we built a SQL-based solution to unify batch and stream workflows

Streaming Data

• Adapting Iceberg for High-Scale Streaming Data
• Snowpipe Streaming: What’s New, Use Cases, and Best Practices
• Common Challenges with Apache Airflow and How to Address Them
• Apache Kafka Use Cases: When To Use It? When Not To?

Cloud Architecture

• Getting Started with Apache Iceberg on Amazon S3
• Effortless Table Management with Adaptive Optimizer for Apache Iceberg: Boost Performance & Cut Costs
• Optimizing Data Storage and Querying with Trino, MinIO, and Apache Iceberg
• Comparing the Top Iceberg Ingestion Tools - Upsolver, ELT, Open Source
• VPC Flow Log Analytics with PuppyGraph and Upsolver
• Snowflake Data Ingestion Strategies Decoded: A Guided Tour for Data Engineers
• What is the Parquet File Format? Use Cases & Benefits

Use Cases

• Introducing Automated Ingestion for dbt Core
• How SQLake Auto-Orchestrates Your Pipelines
• How to publish data to another AWS account’s catalog
• Analyzing Amazon VPC Flow Logs Using SQL

Building Data Pipelines

• 24 Features to Boost Your Data Movement in 2024: Part 2
• 24 Features to Boost Your Data Movement in 2024: Part 1
• The 5 Pillars of Data Observability
• Fivetran MAR Pricing vs Upsolver Volume Pricing
• 6 Popular CDC Tools Compared (July 2023 Edition)
• Airbyte vs Fivetran vs Upsolver – Which is the Best CDC Tool?
• Achieving Upserts with Snowpipe in Snowflake: Strategies and Alternatives
• What is Big Data Ingestion?
• Kafka to Snowflake: What’s the Best Ingestion Method?
• How to Build Streaming Data Pipelines with Redpanda and Upsolver

Change Data Capture

• CDC to Iceberg: 4 Major Challenges, and How We Solved Them
• MySQL CDC to Iceberg Lake in Minutes
• Debezium vs Maxwell: Detailed Comparison of Open-source CDC Tools
• Snowflake CDC: Basics, Scale Challenges, and Tools
• Debezium for CDC: Benefits and Pitfalls
• 4 Steps to Postgres CDC – Replicate Postgres Changes to your Data Lake
• Understanding Debezium Outbox Pattern
• How to Build a MySQL CDC Pipeline in Minutes

Release Notes

2024

• Upsolver August 2024 Feature Summary
• Upsolver July 2024 Feature Summary
• Upsolver June 2024 Feature Summary
• Upsolver May 2024 Feature Summary
• Upsolver April 2024 Feature Summary
• Upsolver March 2024 Feature Summary
• Upsolver February 2024 Feature Summary
• Upsolver January 2024 Feature Summary

Want More?

Check out the blog page on our website for more articles.

If there's a topic we haven't included that you'd like us to cover, please let us know.