PAUSE / RESUME JOB

You can pause and later resume a job using the syntax below, or directly from the Jobs page in the Upsolver user interface, by right-clicking on the individual job menu.

Reasons for pausing a job could be:

• Maintenance - Performing maintenance or upgrades of the source or target database.

• Data Recovery - If errors occur during data processing, you may need to pause the ETL job to investigate and correct the issues. This can help avoid propagating errors into downstream systems.

• Testing - Temporarily halt data ingestion to verify/compare data in different scenarios.

• Reduce Load - you may want to reduce the current load on the source or target system.

While your job is paused, you can make alterations to the job options or add expectations. You can only alter options that are mutable. Please see ALTER JOB for further instructions.

Note

Pause / Resume job is not supported by ingestion or transformation jobs that write to data lake tables.

Syntax

Pause Write

SQL syntax to pause a job in Upsolver.

ALTER JOB <job_name> PAUSE WRITE [IGNORE_WARNINGS = (...)];

Resume Write

SQL syntax to resume a job in Upsolver.

ALTER JOB <job_name> RESUME WRITE;

Examples

The following statement pauses the ingest_web_orders_to_snowflake job:

// Pause the job execution
ALTER JOB ingest_web_orders_to_snowflake PAUSE WRITE;

Furthermore, you can instruct Upsolver to and include the warnings you want to ignore:

// Pause the job execution and ignore warnings
ALTER JOB ingest_web_orders_to_snowflake PAUSE WRITE 
     SKIP_VALIDATIONS = ('DATA_RETENTION');

To resume the ingest_web_orders_to_snowflake job, run the following statement:

// Resume the job execution
ALTER JOB ingest_web_orders_to_snowflake RESUME WRITE;