May 2024

Upsolver new features, enhancements, and bug fixes for May 2024.

2024.05.12-10.26

⬆️ Enhancements

• Upgraded libraries to include recent security patches, enhancing system security and stability

• Non-sync jobs can now write to managed Iceberg tables

• API: Enabled casting to JSON in jobs writing to Amazon Redshift

🔧 Bug Fixes

• Minor bug fixes

2024.05.09-08.33

⬆️ Enhancements

• Upgraded libraries to include recent security patches, enhancing system security and stability

• Information Schema:

  • Added is_external column to the system table system.information_schema.tables to flag whether this is an Iceberg table that is managed by Upsolver, but is not a target for an Upsolver ingestion job

🔧 Bug Fixes

• Ingestion Jobs to Snowflake

  • Use the given commit interval. This change is applied only to jobs created from now on and will not apply to old jobs

2024.05.02-15.37

⬆️ Enhancements

• Snowflake Output: If the target schema does not exist, it will now be automatically created before the table is created

• Iceberg:

  • Delete dangling files from Iceberg tables

  • Expire old snapshots in Iceberg tables

• Libraries upgrade to include security patches

🔧 Bug Fixes

• Fixed an error while reading positional delete files duration Iceberg compaction tasks