PAUSE / RESUME JOB

You can pause and later resume a job using the syntax below, or directly from the Jobs page in the Upsolver user interface, by right-clicking on the individual job menu.

Reasons for pausing a job could be:

• Maintenance - Performing maintenance or upgrades of the source or target database.

• Data Recovery - If errors occur during data processing, you may need to pause the ETL job to investigate and correct the issues. This can help avoid propagating errors into downstream systems.

• Testing - Temporarily halt data ingestion to verify/compare data in different scenarios.

• Reduce Load - you may want to reduce the current load on the source or target system.

While your job is paused, you can make alterations to the job options or add expectations. You can only alter options that are mutable. Please see ALTER JOB for further instructions.

Note

Pause / Resume job is not supported by ingestion or transformation jobs that write to data lake tables.

Syntax

Pause Write

SQL syntax to pause a job in Upsolver.

ALTER JOB <job_name> PAUSE WRITE [IGNORE_WARNINGS = (...)];

Resume Write

SQL syntax to resume a job in Upsolver.

ALTER JOB <job_name> RESUME WRITE;

Examples

The following statement pauses the ingest_web_orders_to_snowflake job:

// Pause the job execution
ALTER JOB ingest_web_orders_to_snowflake PAUSE WRITE;

Furthermore, you can instruct Upsolver to and include the warnings you want to ignore:

// Pause the job execution and ignore warnings
ALTER JOB ingest_web_orders_to_snowflake PAUSE WRITE 
     SKIP_VALIDATIONS = ('DATA_RETENTION');

To resume the ingest_web_orders_to_snowflake job, run the following statement:

// Resume the job execution
ALTER JOB ingest_web_orders_to_snowflake RESUME WRITE;

Pause / resume a job using the UI

Pause Write

You can also pause or resume a job from the Jobs page in the UI. Hover your mouse over the three-dots menu on the job you want to pause:

Pause or resume a job from the Jobs page.

From the job menu, select Pause Load to Target:

Select Pause Load to Target from the Job menu.

You will be presented with a modal window asking you to confirm if you want to pause the job:

Select Pause Load to Target to confirm the operation.

The window also presents you with the SQL syntax for pausing the job, should you wish to copy and paste this into a worksheet to run the statement manually. Note that if you manually run the SQL statement, there is no pre-check and the command will execute immediately.

Click Pause Load to Target to continue, and the job status will refresh and display Writing Paused. Alternatively, click Cancel to exit without pausing the job.

Resume Write

When you are ready to start the job, click on the three-dots menu, and select Resume Load to Target:

Select Resume Load to Target from the Job menu

The job will begin loading data immediately and the job status will display Running.