May 2023

Upsolver new features, enhancements, and bug fixes for May 2023.

Weekly Software Updates

The following software updates were released in May:

CASE WHEN now handles NULL as input and returns the ELSE value.
CDC: Fixed the bug that caused the ingestion of a decimal type column to be converted to binary base64 string.

COLUMN_TRANSFORMATIONS with dependencies between them created the wrong name for the nested column.
Fixed target name column value for Snowflake outputs in the system.information_schema.jobs table.

New SQL syntax for SHOW CREATE is now supported:
- SHOW CREATE JOB "Job name"
- SHOW CREATE TABLE "Table name"
- SHOW CREATE MATERIALIZED VIEW "MV name"
- SHOW CREATE CLUSTER "Cluster name"

PostgreSQL Jobs:
- Support reading 14+ partitioned tables by the root table name instead of the underlying partition table names.
Snowflake Jobs:
- Added query tag to queries executed by Upsolver for easier cost tracking.

Fixed the bug where TABLE_DATA_RETENTION could be disabled by disabling compactions.
Dropping a table while specifying DELETE_DATA = true did not delete data files written by jobs with RUN_PARALLELISM > 1.
Parquet files are now distributed more evenly when ingesting data from Amazon S3 with high execution parallelism.
Fixed a bug when selecting from large materialized views with predicates on key columns would return "Query exceeded input row limit".
Fixed a bug where a job reading from system.information_schema.columns does not write data into a table.
Fixed a bug where querying system.monitoring.jobs can result in an error.
BYTES_SUBSTRING position now starts from 1 as SUBSTRING (previously started from 0).

Support querying all system tables using the syntax: SELECT $*.
Information Schema: added a type_evolution column to the system table. system.information_schema.columns to show all previous types of the column.
Improved statistics in Job Status.

Last updated 1 year ago