Apache Kafka
This article explains how to configure SSL for your Apache Kafka connection.
This article explains how to configure SSL for your Apache Kafka connection in Upsolver, detailing the necessary steps to upload the certificates to the Upsolver servers and configure the connection.
The following guide also applies to configuring your Confluent Cloud connection.
Configure SSL for Apache Kafka
To enable Upsolver to successfully connect to your Apache Kafka cluster using SSL, the key and certificate files generated when SSL was deployed should be provided as part of your Upsolver cluster configuration. This involves uploading the required certificates to the Upsolver servers by running a patch HTTP request for each cluster you wish to use with your connection.
Note that the instructions below were written for a Linux-based system.
If you are working with Windows, you can use a Linux mimicking program or file a ticket via the Upsolver support portal and send the certificates for us to update it for you.
Configure your Upsolver cluster
Step 1: Upload your files
There are two request types you can use to upload the files:
ModifyServerFiles
- Can be used to upload multiple files at once. Replaces existing files, only the files in the latest upload will be saved, and all previously uploaded files will be removed.ModifyServerFile
- Can be used to upload a single file with each request. Does not remove the previously uploaded files.
The name must be unique: uploading a new file with an existing name will replace the previously uploaded file. This applies to both scripts.
For Multiple Files
First, run the following request for the API server:
Then run this request for the cluster you wish to upload the files to:
Note that the two requests only differ in the IDs provided within the URLs for each request.
The first line of the request creates the JSON array serverFiles
, which contains the path
and content
of the file you are uploading.
The path
referenced within the array itself is the path the file is written to within the server; it is also the path that should be provided when using this file to establish a connection.
The content
of the file is passed through as an argument with --arg
. Here, <FILE_PATH>
represents the path to the file you are uploading on your local computer.
This example uploads two files to the server, but the serverFiles
array elements can be adjusted to upload either one or more files. Note that running this request overrides any files that may have been uploaded previously.
For a Single File
To upload a single file without overriding any existing files, run these requests instead:
The name parameter must be unique across different files: using the same name will replace the existing file with that name.
Make sure to replace the placeholder values <API_SERVER_ID>
and <CLUSTER_ID>
, as well as your <API_TOKEN>
and <ORG_ID>
.
To learn how to generate an API token, see Enable API Integration.
Step 2: Roll your cluster
Once the certificates have been uploaded, roll the modified cluster to apply the changes.
Create your connection
To use your key and certificate files to connect Upsolver to your Kafka cluster, you should provide the paths to your uploaded files as part of the properties in the CREATE KAFKA CONNECTION
command.
To allow the connection to be used for reading data, the key store and trust store locations should be configured as CONSUMER_PROPERTIES
.
Example
Last updated