Kafka connection with SQL
To ingest data from your Kafka topic into a table within SQLake, you must first create a connection that provides the proper credentials to access your topic.
CREATE KAFKA CONNECTION
<connection_identifier>
HOST[S] = { '<host>' | ('<host>' [, ...]) }
[ CONSUMER_PROPERTIES = '<properties>' ]
[ VERSION = { CURRENT | LEGACY } ]
[ REQUIRE_STATIC_IP = { TRUE | FALSE } ]
[ SSL = { TRUE | FALSE } ]
[ TOPIC_DISPLAY_FILTER[S] = { '<topic_name>' | ('<topic_name>' [, ...]) } ]
[ COMMENT = '<comment>' ]
Type:
text | list
A single host or a list of Kafka hosts in the format of
hostname:port
.Type:
text_area
(Optional) Extra properties to configure for the consumer.
Values:
{ CURRENT | LEGACY }
Default:
CURRENT
(Optional) Legacy is for anything before 0.10.
Type:
boolean
Default:
true
(Optional) With Upsolver clusters, you can configure how many elastic IPs it should allocate and use within that cluster.
If the cluster running the job has at least one elastic IP set and
REQUIRE_STATIC_IP
is enabled, then the job runs on a server that has an elastic IP associated with itType:
boolean
Default:
false
(Optional) If enabled, SSL is used to connect.
Please contact Upsolver to ensure your CA certificate is supported.
Type:
text | list
(Optional) A single topic or the list of topics to show. If left empty, all topics are visible.
Type:
text
(Optional) A description or comment regarding this connection.
Last modified 6mo ago