Job Monitoring

Upsolver provides integration with popular reporting platforms to enable you to monitor your pipelines from a central dashboard. Using SQL syntax, you can create jobs to export monitoring data.

Supported targets

• Amazon CloudWatch

• Datadog

Syntax

CREATE JOB <job_identifier> 
      [ START_FROM = { NOW | BEGINNING | <timestamp> } ]
AS INSERT INTO [ CLOUDWATCH | DATADOG ] <connection_identifier>
      [ NAMESPACE = '<namespace>' ]
      [ MAP_COLUMNS_BY_NAME ] 
SELECT ...
      [ tags ]
      <timestamp> AS time

Jump to

• MAP_COLUMNS_BY_NAME

• NAMESPACE

• START_FROM

MAP_COLUMNS_BY_NAME

Maps columns from the SELECT statement to the table by the names of the columns in the query. For more information see MAP_COLUMS_BY_NAME.

NAMESPACE

Type: text

(Optional) The target namespace for your Upsolver metrics in Amazon CloudWatch. If the namespace does not already exist, Upsolver creates it for you.

Note: if you are using the NAMESPACE option, ensure this is defined immediately after the connection identifier.

START_FROM

Values: { NOW | BEGINNING | <timestamp> }

Default: NOW

(Optional) Configures the time to start sending data to the target.

Query structure

Your job should include the following:

• At least one metric

• The time when the metric data was captured

• Optionally, you can include tags, which are metadata strings, e.g. the name of the cluster or job