Blog

Learn about data ingestion and associated technologies, industry trends, architecture, strategies, and more.

Upsolver News

• Upsolver Named Data Movement Partner by PuppyGraph

• Upsolver Announces Zero-ETL and lakehouse Optimization for Apache Iceberg

• Data Ingestion Solutions Review: 11 Key Takeaways

• Announcing: Upsolver joins the Connect with Confluent (CwC) Program

• A Scalable Way to Deliver NoSQL Prod Data to Analytics Environments

• Upsolver Announces Support for AWS for Advertising and Marketing Initiative

Data Lakes & Lakehouses

• An Introduction to the Data Lakehouse for Data Warehouse Users

• Ingesting Operational Data into an Analytics Lakehouse on Iceberg

• Iceberg Architecture Examples: How Iceberg powers data and ML applications at Adobe, Netflix, LinkedIn, Salesforce, and Airbnb

• Lakehouse vs. Data Lake: The Ultimate Guide

• How Apache Iceberg is Reshaping Data Lake File Management

• Apache Iceberg vs Parquet – File Formats vs Table Formats

• Moving data from a lake to Snowflake

• Migrating a Self-Managed Data Lake to Snowflake

• Why we built a SQL-based solution to unify batch and stream workflows

Streaming Data

• Snowpipe Streaming: What’s New, Use Cases, and Best Practices

• Common Challenges with Apache Airflow and How to Address Them

• Apache Kafka Use Cases: When To Use It? When Not To?

Cloud Architecture

• Snowflake Data Ingestion Strategies Decoded: A Guided Tour for Data Engineers

• What is the Parquet File Format? Use Cases & Benefits

Use Cases

• Introducing Automated Ingestion for dbt Core

• How SQLake Auto-Orchestrates Your Pipelines

• How to publish data to another AWS account’s catalog

• Analyzing Amazon VPC Flow Logs Using SQL

Building Data Pipelines

• 24 Features to Boost Your Data Movement in 2024: Part 2

• 24 Features to Boost Your Data Movement in 2024: Part 1

• The 5 Pillars of Data Observability

• Fivetran MAR Pricing vs Upsolver Volume Pricing

• 6 Popular CDC Tools Compared (July 2023 Edition)

• Airbyte vs Fivetran vs Upsolver – Which is the Best CDC Tool?

• Achieving Upserts with Snowpipe in Snowflake: Strategies and Alternatives

• What is Big Data Ingestion?

• Kafka to Snowflake: What’s the Best Ingestion Method?

• How to Build Streaming Data Pipelines with Redpanda and Upsolver

Change Data Capture

• MySQL CDC to Iceberg Lake in Minutes

• Debezium vs Maxwell: Detailed Comparison of Open-source CDC Tools

• Snowflake CDC: Basics, Scale Challenges, and Tools

• Debezium for CDC: Benefits and Pitfalls

• 4 Steps to Postgres CDC – Replicate Postgres Changes to your Data Lake

• Understanding Debezium Outbox Pattern

• How to Build a MySQL CDC Pipeline in Minutes

Release Notes

2024

• Upsolver April 2024 Feature Summary

• Upsolver March 2024 Feature Summary

• Upsolver February 2024 Feature Summary

• Upsolver January 2024 Feature Summary

2023

• Upsolver December 2023 Feature Summary

• Upsolver November 2023 Feature Summary

• Upsolver October 2023 Feature Summary

Want More?

Check out the blog page on our website for more articles.

If there's a topic we haven't included that you'd like us to cover, please let us know.