LogoLogo
OverviewQuickstartsHow To GuidesReferenceArticlesSupport
Quickstarts
Quickstarts
  • Quickstarts
  • DATA INGESTION WIZARD
    • Using the Wizard
      • Source Set-up
        • Amazon Kinesis
        • Amazon S3
        • Apache Kafka
        • Confluent Cloud
        • Microsoft SQL Server
        • MongoDB
        • MySQL
        • PostgreSQL
      • Target Set-up
        • Amazon Redshift
        • AWS Glue Data Catalog
        • ClickHouse
        • Polaris Catalog
        • Snowflake
      • Job Configuration
        • Job Configuration
        • Job Configuration for CDC
      • Review and Run Job
  • CONNECTORS
    • Connectors
      • Amazon Kinesis
      • Amazon Redshift
      • Amazon S3
      • Apache Kafka
      • AWS Glue Data Catalog
      • ClickHouse
      • Confluent Cloud
      • Elasticsearch
      • Microsoft SQL Server
      • MongoDB
      • MySQL
      • Polaris Catalog
      • PostgreSQL
      • Snowflake
  • JOBS
    • Ingestion
      • Job Basics
        • Ingest to a Staging Table
        • Output to a Target Table
      • Stream and File Sources
        • Amazon Kinesis
        • Amazon S3
        • Apache Kafka
        • Confluent Kafka
      • CDC Sources
        • Microsoft SQL Server
        • MongoDB
        • MySQL
        • PostgreSQL
    • Transformation
      • Updating Data
        • Upsert Data to a Target Table
        • Delete Data from a Target Table
        • Aggregate and Output Data
        • Join Two Data Streams
      • Data Targets
        • Output to Amazon Athena
        • Output to Amazon Redshift
        • Output to Amazon S3
        • Output to Elasticsearch
        • Output to Snowflake
  • APACHE ICEBERG
    • Optimize Your Iceberg Tables
    • Install the Iceberg Table Analyzer
Powered by GitBook
On this page
  • Create a job with the Wizard
  • Set up your source
  • Set up your target
  • Configure the ingestion job
  • Review and run the job
  1. DATA INGESTION WIZARD

Using the Wizard

This quickstart shows you how to use the Wizard to create ingestion jobs.

Last updated 8 months ago

The Upsolver Data Ingestion Wizard is the easy, no-code option for ingesting your data into Amazon Redshift, AWS Glue Data Catalog, ClickHouse, Polaris Catalog, and Snowflake. Use the Wizard to create a job, or use the auto-generated code as a basis for creating more advanced use cases by extending the functionality using familiar SQL syntax.

For Elasticsearch, Amazon S3, and PostgreSQL targets, the Wizard will provide a code template for configuring your connections and job, based on the data source you select.

The Wizard creates a job in four simple steps:

Create a job with the Wizard

Login to your Upsolver account and, from the left-hand menu, click Jobs. On the Jobs page, click the Create New Job button. This opens the Ingestion Wizard. Click on the card for the data source from where you want to copy your data and the card for your data target:

Set up your source

The Wizard guides you through the steps for setting up your data source:

Set up your target

Follow the guide for setting up your target:

Configure the ingestion job

Upsolver supports various data sources, from files, streaming, and CDC data. Follow the applicable guides for configuring your job based on your source:

Review and run the job

The Wizard auto-generates the SQL code for creating your job, and sub-jobs where applicable. You can open this code in a query window, and enhance the job using advanced features.

Amazon Kinesis
Amazon S3
Apache Kafka
Confluent Cloud
Microsoft SQL Server
MongoDB
MySQL
PostgreSQL
Amazon Redshift
AWS Glue Data Catalog
ClickHouse
Polaris Catalog
Snowflake
Job Configuration
Job Configuration for CDC
Review and Run Job
Set up your source
Set up your target
Configure your job
Review and run the job
Open the Ingestion Wizard and follow the steps to ingest your data.