LogoLogo
OverviewQuickstartsHow To GuidesReferenceArticlesSupport
Quickstarts
Quickstarts
  • Quickstarts
  • DATA INGESTION WIZARD
    • Using the Wizard
      • Source Set-up
        • Amazon Kinesis
        • Amazon S3
        • Apache Kafka
        • Confluent Cloud
        • Microsoft SQL Server
        • MongoDB
        • MySQL
        • PostgreSQL
      • Target Set-up
        • Amazon Redshift
        • AWS Glue Data Catalog
        • ClickHouse
        • Polaris Catalog
        • Snowflake
      • Job Configuration
        • Job Configuration
        • Job Configuration for CDC
      • Review and Run Job
  • CONNECTORS
    • Connectors
      • Amazon Kinesis
      • Amazon Redshift
      • Amazon S3
      • Apache Kafka
      • AWS Glue Data Catalog
      • ClickHouse
      • Confluent Cloud
      • Elasticsearch
      • Microsoft SQL Server
      • MongoDB
      • MySQL
      • Polaris Catalog
      • PostgreSQL
      • Snowflake
  • JOBS
    • Ingestion
      • Job Basics
        • Ingest to a Staging Table
        • Output to a Target Table
      • Stream and File Sources
        • Amazon Kinesis
        • Amazon S3
        • Apache Kafka
        • Confluent Kafka
      • CDC Sources
        • Microsoft SQL Server
        • MongoDB
        • MySQL
        • PostgreSQL
    • Transformation
      • Updating Data
        • Upsert Data to a Target Table
        • Delete Data from a Target Table
        • Aggregate and Output Data
        • Join Two Data Streams
      • Data Targets
        • Output to Amazon Athena
        • Output to Amazon Redshift
        • Output to Amazon S3
        • Output to Elasticsearch
        • Output to Snowflake
  • APACHE ICEBERG
    • Optimize Your Iceberg Tables
    • Install the Iceberg Table Analyzer
Powered by GitBook
On this page
  • Step 1 - Connect to SQL Server
  • Create a new connection
  • Use an existing connection
  • Step 2 - Select schemas, tables, and columns to ingest
  1. DATA INGESTION WIZARD
  2. Using the Wizard
  3. Source Set-up

Microsoft SQL Server

Follow these steps to use Microsoft SQL Server as your source.

Last updated 11 months ago

Step 1 - Connect to SQL Server

Create a new connection

Click Create a new connection, if it is not already selected. You can find instructions on .

In the Connection String textbox, enter your connection string in the following format:

jdbc:sqlserver://HOST;DatabaseName=MyDb

where:

  • HOST - the hostname or IP address of the SQL Server instance you want to connect to, for example, ms-sqlserver-1.myendpoint.

  • DatabaseName - the name of the database you want to connect to. The above example uses MyDb; replace this with the name of the database you want to work with.

For further connection options, visit

Provide the Username and Password to authenticate to the database.

In the Name your connection field, type in the name for this connection. Please note this connection will be available to other users in your organization.

Use an existing connection

By default, if you have already created a connection, Upsolver selects Use an existing connection, and your SQL Server connection is populated in the list.

For organizations with multiple connections, select the source connection you want to use.

Step 2 - Select schemas, tables, and columns to ingest

There are two ways to replicate objects to the target:

  1. Manually select the schemas, tables, and columns.

  2. Use regular expressions to specify which tables are included and which columns are excluded.

The following examples show how to use a regular expression to include specific tables:

Expression
Results

schema_name.*

Select all tables in the schema_name schema.

schema_name.users, schema_name.items

Select users and items tables in the schema_name schema.

schema_name.items_.*

Select all tables in the schema_name schema that start with items_.

By default, Upsolver ingests all columns in the tables that match the regular expression. Below are examples of regular expressions to exclude columns from included tables:

Expression
Results

schema_name.users.address_.*

Select all columns starting with address_ in the users table in the schema_name schema.

schema_name.*.(.*_pii)

Select all columns ending in _pii across all tables in the schema_name schema.

Schema evolution

By default, new schemas, tables, and columns added after the job is launched, will be replicated to the target.

You can overwrite the default behavior and set specific behavior for newly created schemas, tables in a specific schema, or columns in a specific table.

Microsoft SQL Server JDBC URI documentation.
how to enable SQL Server for CDC in this guide
Create a new connection to Microsoft SQL Server to ingest your CDC data.
Select your existing SQL Server connection to use for your ingestion job.