Settings
This page describes the Settings tab for stream and file sources.
The Settings tab displays the SQL code to create the job, along with job options, and details.
SQL
View the full SQL code used to generate the job. This code includes all job and source options provided when you created the job, or the default options used by Upsolver.
The code can be copied into a Worksheet if you want to re-use it.
Options
The job options provided when you created the job or the default options used by Upsolver:
COMPUTE_CLUSTER
The name of the cluster than that executes the job.
Click on the link to view further details about the cluster.
CONTENT_TYPE
The file type of the content being ingested, e.g. JSON.
COMPRESSION
The file compression format, e.g. AUTO.
RUN_PARALLELISM
The number of parser jobs to run in parallel per minute.
READER_SHARDS
The number of readers being used in parallel to read the stream.
WRITE_INTERVAL
The time frequency for writing the data to the target.
STORE_RAW_DATA
Either true or false to denote whether an additional copy of the data is stored in its original format.
For more information on using the above job options, please see the reference for your source:
Details
The following details are included:
Description
The optional comment provided when the job was created or updated.
Created At
The date and time when the job was initially created.
Last Modified At
The date and time when the job was last updated.
Created By
The username of the person in your organization who created the job.
Last Modified By
The username of the last person in your organization to update the job.
Id
The globally unique identifier for the job.
This Id can be used when querying system.information_schema.jobs and the system.monitoring.jobs tables.