Settings

This page describes the Settings tab for stream and file sources.

The Settings tab displays the SQL code to create the job, along with job options, and details.

SQL

View the full SQL code used to generate the job. This code includes all job and source options provided when you created the job, or the default options used by Upsolver.

The code can be copied into a Worksheet if you want to re-use it.

Options

The job options provided when you created the job or the default options used by Upsolver:

Job Option	Value
COMPUTE_CLUSTER	The name of the cluster than that executes the job. Click on the link to view further details about the cluster.
CONTENT_TYPE	The file type of the content being ingested, e.g. JSON.
COMPRESSION	The file compression format, e.g. AUTO.
RUN_PARALLELISM	The number of parser jobs to run in parallel per minute.
READER_SHARDS	The number of readers being used in parallel to read the stream.
WRITE_INTERVAL	The time frequency for writing the data to the target.
STORE_RAW_DATA	Either true or false to denote whether an additional copy of the data is stored in its original format.

Job Option

Value

COMPUTE_CLUSTER

The name of the cluster than that executes the job.

Click on the link to view further details about the cluster.

CONTENT_TYPE

The file type of the content being ingested, e.g. JSON.

COMPRESSION

The file compression format, e.g. AUTO.

RUN_PARALLELISM

The number of parser jobs to run in parallel per minute.

READER_SHARDS

The number of readers being used in parallel to read the stream.

WRITE_INTERVAL

The time frequency for writing the data to the target.

STORE_RAW_DATA

Either true or false to denote whether an additional copy of the data is stored in its original format.

For more information on using the above job options, please see the reference for your source:

Details

The following details are included:

Detail	Value
Description	The optional comment provided when the job was created or updated.
Created At	The date and time when the job was initially created.
Last Modified At	The date and time when the job was last updated.
Created By	The username of the person in your organization who created the job.
Last Modified By	The username of the last person in your organization to update the job.
Id	The globally unique identifier for the job. This Id can be used when querying system.information_schema.jobs and the system.monitoring.jobs tables.

Detail

Value

Description

The optional comment provided when the job was created or updated.

Created At

The date and time when the job was initially created.

Last Modified At

The date and time when the job was last updated.

Created By

The username of the person in your organization who created the job.

Last Modified By

The username of the last person in your organization to update the job.

The globally unique identifier for the job.

This Id can be used when querying system.information_schema.jobs and the system.monitoring.jobs tables.