May 2023

Upsolver new features, enhancements, and bug fixes for May 2023.

Weekly Software Updates

The following software updates were released in May:


🔧 Bug Fixes

  • CASE WHEN now handles NULL as input and returns the ELSE value.

  • CDC: Fixed the bug that caused the ingestion of a decimal type column to be converted to binary base64 string.


⬆️ Enhancements

  • Validate that the first parameter in an ARRAY_JOIN is not a literal.

  • Ingestion wizard now supports Amazon Kinesis source.

🔧 Bug Fixes

  • COLUMN_TRANSFORMATIONS with dependencies between them created the wrong name for the nested column.

  • Fixed target name column value for Snowflake outputs in the table.


New Features

    • SHOW CREATE JOB "Job name"

    • SHOW CREATE TABLE "Table name"


    • SHOW CREATE CLUSTER "Cluster name"

⬆️ Enhancements

  • PostgreSQL Jobs:

    • Support reading 14+ partitioned tables by the root table name instead of the underlying partition table names.

  • Snowflake Jobs:

    • Added query tag to queries executed by Upsolver for easier cost tracking.

🔧 Bug Fixes

  • Fixed the bug where TABLE_DATA_RETENTION could be disabled by disabling compactions.

  • Dropping a table while specifying DELETE_DATA = true did not delete data files written by jobs with RUN_PARALLELISM > 1.

  • Parquet files are now distributed more evenly when ingesting data from Amazon S3 with high execution parallelism.

  • Fixed a bug when selecting from large materialized views with predicates on key columns would return "Query exceeded input row limit".


⬆️ Enhancements

  • Support querying all system tables using the syntax: SELECT $*.

🔧 Bug Fixes

  • Fixed the issue of inviting a member to the organization not working.

  • Prevented the creation of sync jobs that read from system tables.

  • Fixed a bug in jobs when writing to Amazon S3 with a dynamic location.

  • Fixed a bug that caused some columns to be missing when reading from a table.