Job configuration guide for CDC

General job configuration

Set how often you want to update the target. The job will check the source for new events every minute, and you can set the target write interval in Minutes, Hours, or Days.

Frequent writes provide up-to-date information but may be costly, especially for Snowflake.

Select the Replication Mode to specify how changes in the source should be replicated to the target:

• Exact replication applies inserts, updates, and deletes on the target as per the source.

• Soft deletion marks rows deleted in the source as deleted in a column named UPSOLVER_IS_DELETED in the target (you can rename this column).

• Append only appends (inserts) the record to the target, indicating the record type in a dedicated column named UPSOLVER_OPERATION_TYPE (you can rename this column).

  The column values will be one of the following: Insert, Update, Delete, Snapshot.

Upsolver uses distributed locking technology to keep events strongly ordered. The ingestion timestamp is stored in a dedicated column reflecting the order. The column name is UPSOLVER_EVENT_TIME by default, but you can change it.