Confluent Cloud

This quickstart shows you how to create a Confluent Cloud connection.

Create a connection to Confluent Kafka

To ingest data from your Confluent topic into a table within Upsolver, you must first create a connection that provides the appropriate credentials to access your topic.

Your connection is persistent, so you won't need to re-create it for every job. The connection is also shared with other users in your organization.

Here’s the code for creating a connection to Confluent Kafka:

// Syntax
CREATE KAFKA CONFLUENT CONNECTION <connection_identifier> 
 HOSTS = ('<bootstrap_server_1>:<port_number>','<bootstrap_server_2>:<port_number>') 
 CONSUMER_PROPERTIES = '<bootstrap_server_1>:<port_number> 
    security.protocol=SASL_SSL
    sasl.jaas.config=org.apache.kafka.common.security.plain.PlainLoginModule
        required username="<kafka_username>"   password="<kafka_password>";
    ssl.endpoint.identification.algorithm=https
    sasl.mechanism=PLAIN';

// Example
CREATE KAFKA CONFLUENT my_confluent_connection
 HOSTS = ('foo:9092', 'bar:9092')
 CONSUMER_PROPERTIES = 'security.protocol = SASL_SSL
    sasl.jaas.config = org.apache.kafka.common.security.plain.PlainLoginModule
        required username = "API_KEY"   password = "SECRET";
    ssl.endpoint.identification.algorithm = https
    sasl.mechanism = PLAIN';

After you complete this step, you should see the my_confluent_connection connection in your navigation tree.


Learn More

Last updated