May 2023

Upsolver new features, enhancements, and bug fixes for May 2023.

Weekly Software Updates

The following software updates were released in May:

2023.05.28-18.43

🔧 Bug Fixes

• CASE WHEN now handles NULL as input and returns the ELSE value.

• CDC: Fixed the bug that caused the ingestion of a decimal type column to be converted to binary base64 string.

---

2023.05.17-13.45

⬆️ Enhancements

• Validate that the first parameter in an ARRAY_JOIN is not a literal.
• Ingestion wizard now supports Amazon Kinesis source.

🔧 Bug Fixes

• COLUMN_TRANSFORMATIONS with dependencies between them created the wrong name for the nested column.
• Fixed target name column value for Snowflake outputs in the system.information_schema.jobs table.

---

2023.05.15-02.23

✨ New Features

• New SQL syntax for SHOW CREATE is now supported:

  • SHOW CREATE JOB "Job name"

  • SHOW CREATE TABLE "Table name"

  • SHOW CREATE MATERIALIZED VIEW "MV name"

  • SHOW CREATE CLUSTER "Cluster name"

⬆️ Enhancements

• PostgreSQL Jobs:

  • Support reading 14+ partitioned tables by the root table name instead of the underlying partition table names.

• Snowflake Jobs:

  • Added query tag to queries executed by Upsolver for easier cost tracking.

🔧 Bug Fixes

• Fixed the bug where TABLE_DATA_RETENTION could be disabled by disabling compactions.

• Dropping a table while specifying DELETE_DATA = true did not delete data files written by jobs with RUN_PARALLELISM > 1.

• Parquet files are now distributed more evenly when ingesting data from Amazon S3 with high execution parallelism.

• Fixed a bug when selecting from large materialized views with predicates on key columns would return "Query exceeded input row limit".

• Fixed a bug where a job reading from system.information_schema.columns does not write data into a table.
• Fixed a bug where querying system.monitoring.jobs can result in an error.
• BYTES_SUBSTRING position now starts from 1 as SUBSTRING (previously started from 0).

---

2023.05.04-07.39

⬆️ Enhancements

• Support querying all system tables using the syntax: SELECT $*.

• Information Schema: added a type_evolution column to the system table. system.information_schema.columns to show all previous types of the column.
• Improved statistics in Job Status.

🔧 Bug Fixes

• Fixed the issue of inviting a member to the organization not working.

• Prevented the creation of sync jobs that read from system tables.

• Fixed a bug in jobs when writing to Amazon S3 with a dynamic location.

• Fixed a bug that caused some columns to be missing when reading from a table.