Upsolver SQLake
Contact Support
Search…
⌃K
Links

Kafka connection with SQL

To ingest data from your Kafka topic into a table within SQLake, you must first create a connection that provides the proper credentials to access your topic.

Syntax

CREATE KAFKA CONNECTION
<connection_identifier>
HOST[S] = { '<host>' | ('<host>' [, ...]) }
[ CONSUMER_PROPERTIES = '<properties>' ]
[ VERSION = { CURRENT | LEGACY } ]
[ REQUIRE_STATIC_IP = { TRUE | FALSE } ]
[ SSL = { TRUE | FALSE } ]
[ TOPIC_DISPLAY_FILTER[S] = { '<topic_name>' | ('<topic_name>' [, ...]) } ]
[ COMMENT = '<comment>' ]

Jump to

Connection options

HOST[S]

Type: text | list
A single host or a list of Kafka hosts in the format of hostname:port.

CONSUMER_PROPERTIES — editable

Type: text_area
(Optional) Extra properties to configure for the consumer.

VERSION

Values: { CURRENT | LEGACY }
Default: CURRENT
(Optional) Legacy is for anything before 0.10.

REQUIRE_STATIC_IP — editable

Type: boolean
Default: true
(Optional) With Upsolver clusters, you can configure how many elastic IPs it should allocate and use within that cluster.
If the cluster running the job has at least one elastic IP set and REQUIRE_STATIC_IP is enabled, then the job runs on a server that has an elastic IP associated with it

SSL — editable

Type: boolean
Default: false
(Optional) If enabled, SSL is used to connect.
Please contact Upsolver to ensure your CA certificate is supported.

TOPIC_DISPLAY_FILTER[S] — editable

Type: text | list
(Optional) A single topic or the list of topics to show. If left empty, all topics are visible.

COMMENT — editable

Type: text
(Optional) A description or comment regarding this connection.

Minimum example

Full example

Previous
Glue Catalog connection with SQL
Next
Kinesis connection with SQL
Last modified 6mo ago