May 2024

Upsolver new features, enhancements, and bug fixes for May 2024.

Release Notes Blog

For more detailed information on these updates, check out the Upsolver June 2024 Feature Summary blog.

2024.05.28-11.58

⬆️ Enhancements

• Schema evolution and replication support for jobs writing to Amazon Redshift

🔧 Bug Fixes

• Fixed an issue where 2-minute merge files were sometimes not properly deleted when deleting Materialized Views

• Fixed a bug where temporary files wouldn't be deleted in the index creation task when the task failed

• Transformation jobs:

  • Made GROUP BY expressions case insensitive relative to the SELECT expressions

• Minor bug fixes

---

2024.05.23-08.45

⬆️ Enhancements

• Upgraded the Amazon Redshift driver

🔧 Bug Fixes

• Fixed CDC client sometimes becoming temporarily stuck after server replacement

• Minor bug fixes

---

2024.05.19-13.23

🔧 Bug Fixes

• Replication jobs:

  • Fixed snapshotting of tables sometimes being stuck in CDC process

• Fixed a bug in jobs writing to Iceberg tables where using CAST to JSON type expressions caused double encoding of fields inside the JSON string

• Minor bug fixes

---

2024.05.12-10.26

⬆️ Enhancements

• Upgraded libraries to include recent security patches, enhancing system security and stability

• Non-sync jobs can now write to managed Iceberg tables

• API: Enabled casting to JSON in jobs writing to Amazon Redshift

🔧 Bug Fixes

• Minor bug fixes

---

2024.05.09-08.33

⬆️ Enhancements

• Upgraded libraries to include recent security patches, enhancing system security and stability

• Information Schema:

  • Added is_external column to the system table system.information_schema.tables to flag whether this is an Iceberg table that is managed by Upsolver, but is not a target for an Upsolver ingestion job

🔧 Bug Fixes

• Ingestion Jobs to Snowflake

  • Use the given commit interval. This change is applied only to jobs created from now on and will not apply to old jobs

---

2024.05.02-15.37

⬆️ Enhancements

• Snowflake Output: If the target schema does not exist, it will now be automatically created before the table is created

• Iceberg:

  • Delete dangling files from Iceberg tables

  • Expire old snapshots in Iceberg tables

• Libraries upgrade to include security patches

🔧 Bug Fixes

• Fixed an error while reading positional delete files duration Iceberg compaction tasks