Amazon Kinesis
This article describes how to create a connection to Amazon Kinesis using a SQL command.
To ingest data from your Amazon Kinesis stream into a table within SQLake, you must first create a connection that provides the appropriate credentials to access your topic.
CREATE KINESIS CONNECTION
<connection_identifier>
[{ AWS_ROLE = '<role_arn>'
EXTERNAL_ID = '<external_id>'
| AWS_ACCESS_KEY_ID = '<key_id>'
AWS_SECRET_ACCESS_KEY = '<key>' }]
REGION = '<region>'
[ READ_ONLY = { TRUE | FALSE } ]
[ MAX_WRITERS = <integer> ]
[ STREAM_DISPLAY_FILTER[S] = { '<stream_name>' | ('<stream_name>' [, ...]) } ]
[ COMMENT = '<comment>' ]
Type:
text
If omitted, the role created when integrating Upsolver with the AWS account is used.
Type:
text
If omitted, the role created when integrating Upsolver with the AWS account is used.
Type:
text
If omitted, the role created when integrating Upsolver with the AWS account is used.
Type:
text
If omitted, the role created when integrating Upsolver with the AWS account is used.
Type:
text
The AWS region to use.
Type:
boolean
Default:
false
(Optional) When
true
, the connection can only be used to read data from Kinesis and not for writing data to Kinesis.Type:
integer
Default:
20
(Optional) The number of maximum parallel writers to Kinesis.
Type:
text | list
(Optional) A single stream or the list of streams to show. If left empty, all streams are visible.
Type:
text
(Optional) A description or comment regarding this connection.
CREATE KINESIS CONNECTION my_kinesis_connection
REGION = 'us-east-1';
Note: This example uses the default credentials from Upsolver's integration with AWS.
CREATE KINESIS CONNECTION my_kinesis_connection
AWS_ROLE = 'arn:aws:iam::123456789012:role/upsolver-sqlake-role'
REGION = 'us-east-1'
READ_ONLY = true
MAX_WRITERS = 22
STREAM_DISPLAY_FILTERS = ('stream1', 'stream2')
COMMENT = 'kinesis connection example';
Last modified 14d ago