LogoLogo
OverviewQuickstartsHow To GuidesReferenceArticlesSupport
Quickstarts
Quickstarts
  • Quickstarts
  • DATA INGESTION WIZARD
    • Using the Wizard
      • Source Set-up
        • Amazon Kinesis
        • Amazon S3
        • Apache Kafka
        • Confluent Cloud
        • Microsoft SQL Server
        • MongoDB
        • MySQL
        • PostgreSQL
      • Target Set-up
        • Amazon Redshift
        • AWS Glue Data Catalog
        • ClickHouse
        • Polaris Catalog
        • Snowflake
      • Job Configuration
        • Job Configuration
        • Job Configuration for CDC
      • Review and Run Job
  • CONNECTORS
    • Connectors
      • Amazon Kinesis
      • Amazon Redshift
      • Amazon S3
      • Apache Kafka
      • AWS Glue Data Catalog
      • ClickHouse
      • Confluent Cloud
      • Elasticsearch
      • Microsoft SQL Server
      • MongoDB
      • MySQL
      • Polaris Catalog
      • PostgreSQL
      • Snowflake
  • JOBS
    • Ingestion
      • Job Basics
        • Ingest to a Staging Table
        • Output to a Target Table
      • Stream and File Sources
        • Amazon Kinesis
        • Amazon S3
        • Apache Kafka
        • Confluent Kafka
      • CDC Sources
        • Microsoft SQL Server
        • MongoDB
        • MySQL
        • PostgreSQL
    • Transformation
      • Updating Data
        • Upsert Data to a Target Table
        • Delete Data from a Target Table
        • Aggregate and Output Data
        • Join Two Data Streams
      • Data Targets
        • Output to Amazon Athena
        • Output to Amazon Redshift
        • Output to Amazon S3
        • Output to Elasticsearch
        • Output to Snowflake
  • APACHE ICEBERG
    • Optimize Your Iceberg Tables
    • Install the Iceberg Table Analyzer
Powered by GitBook
On this page
  1. CONNECTORS
  2. Connectors

Amazon Kinesis

This quickstart describes how to create an Amazon Kinesis connection.

Last updated 11 months ago

Create a connection to Amazon Kinesis

To ingest data from your Amazon Kinesis stream using Upsolver, you must first create a connection that provides the appropriate credentials to access your topic.

Your connection is persistent, so you won't need to re-create it for every job. The connection is also shared with other users in your organization.

Here’s the code for creating a connection to Amazon Kinesis:

// Syntax
CREATE KINESIS CONNECTION <connection_identifier> 
    AWS_ROLE = '<role_arn>' 
    REGION = '<region>'; 

// Example
CREATE KINESIS CONNECTION my_kinesis_connection
    AWS_ROLE = 'arn:aws:iam::123456789012:role/upsolver-sqlake-role'
    REGION = 'us-east-1';

To break down exactly what’s happening, let’s go through the code. In the following line, you create an connection named my_kinesis_connection:

CREATE KINESIS CONNECTION my_kinesis_connection

Next, you identify your role within your organization's framework on AWS. Please refer to this page for .

AWS_ROLE = 'arn:aws:iam::111111111111:role/<upsolver-role-*'

For future reference, your AWS_ROLE can be copied from your .

Set the AWS region you want to use:

REGION = 'us-east-1'

After you complete this step, you should see the my_kinesis_connection connection in your navigation tree.


Learn More

Please see the SQL command reference for for the full list of connection options, and examples.

more information on AWS roles
AWS IAM user page
Amazon Kinesis