Comment on page
PostgreSQL setup guide
Follow these steps to use PostgreSQL as your source.
Upsolver supports ingesting CDC data from relational databases including PostgreSQL. Upsolver provides CDC capabilities by running a Debezium Engine under the hood. Connectors detect and ingest changes automatically.
Select an existing PostgreSQL connection, or create a new one.
Enter your connection string in the following format:
HOST- hostname (e.g. database instance endpoint in AWS RDS)
PORT- port number
DB_NAME- database name
Provide the username and password to authenticate to the database.
Upsolver uses a Heartbeat table to protect your database server from high disk usage. Although this is an optional setting, it is best practice to include a Heartbeat table, especially when the source database does not contain at least one frequently changing table. To learn more, and get the commands to create the Heartbeat table, see the PostgreSQL prerequisite setup.
There are two ways to replicate objects to the target:
- 1.Manually select the schemas, tables, and columns.
- 2.Use regular expressions to specify which tables are included and which columns are excluded.
The following examples show how to use a regular expression to include specific tables:
By default, Upsolver ingests all columns in the tables that match the regular expression. Below are examples of regular expressions to exclude columns from included tables:
By default, new schemas, tables, and columns added after the job is launched, will be replicated to the target.
You can overwrite the default behavior and set specific behavior for newly created schemas, tables in a specific schema, or columns in a specific table.