Comment on page
Create a connection to Apache Kafka
This quickstart shows you how to create an Apache Kafka connection.
To consume data from your cluster you must first create a connection to Apache Kafka. This connection enables you to configure the AWS IAM credentials, bucket names, and prefixes that Upsolver needs to access the data. You can create a connection using familiar SQL syntax.
Here's the code to create an Apache Kafka connection:
// Syntax
CREATE KAFKA CONNECTION <KAFKA_CONNECTION_NAME>
HOSTS = ('<bootstrap_server_1>:<port_number>','<bootstrap_server_2>:<port_number>')
CONSUMER_PROPERTIES = '<bootstrap_server_1>:<port_number>
security.protocol=SASL_SSL
sasl.jaas.config=org.apache.kafka.common.security.plain.PlainLoginModule required username="<kafka_username>" password="<kafka_password>";
ssl.endpoint.identification.algorithm=https
sasl.mechanism=PLAIN';
// Example
CREATE KAFKA CONNECTION my_kafka_connection
HOSTS = ('pkc-2396y.us-east-1.aws.confluent.cloud:9092')
CONSUMER_PROPERTIES =
'bootstrap.servers=pkc-2396y.us-east-1.aws.confluent.cloud:9092
security.protocol=SASL_SSL
sasl.jaas.config=org.apache.kafka.common.security.plain.PlainLoginModule required username="XXXXXXXX" password="-----------";
ssl.endpoint.identification.algorithm=https
sasl.mechanism=PLAIN';