Links
Comment on page

Job Monitoring

Upsolver provides integration with popular reporting platforms to enable you to monitor your pipelines from a central dashboard. Using SQL syntax, you can create jobs to export monitoring data.

Supported targets

Syntax

CREATE JOB <job_identifier>
[ START_FROM = { NOW | BEGINNING | <timestamp> } ]
AS INSERT INTO [ CLOUDWATCH | DATADOG ] <connection_identifier>
[ NAMESPACE = '<namespace>' ]
[ MAP_COLUMNS_BY_NAME ]
SELECT ...
[ tags ]
<timestamp> AS time
Jump to

MAP_COLUMNS_BY_NAME

Maps columns from the SELECT statement to the table by the names of the columns in the query. For more information see MAP_COLUMS_BY_NAME.

NAMESPACE

Type: text
(Optional) The target namespace for your Upsolver metrics in Amazon CloudWatch. If the namespace does not already exist, Upsolver creates it for you.
Note: if you are using the NAMESPACE option, ensure this is defined immediately after the connection identifier.

START_FROM

Values: { NOW | BEGINNING | <timestamp> }
Default: NOW
(Optional) Configures the time to start sending data to the target.

Query structure

Your job should include the following:
  • At least one metric
  • The time when the metric data was captured
  • Optionally, you can include tags, which are metadata strings, e.g. the name of the cluster or job