June 2024

Upsolver new features, enhancements, and bug fixes for June 2024.


⬆️ Enhancements

  • Query Iceberg Tables - Customers can now query Iceberg tables using Upsolver's Query Engine for preview

  • Auto Sharding: Output files can now be split across shards within a partition

  • Improved the compaction speed for sorted Iceberg tables

🔧 Bug Fixes

  • Fixed a bug that caused jobs writing to Iceberg tables not to produce any rows when the job's source was a system table

  • Fixed Iceberg creating dangling files during failed compactions

  • CDC Inputs: Implemented deletion of intermediate files that store the metadata of the source database

  • Fixed the shard number in system.monitoring.recent_compactions

  • External Iceberg Tables: Added support for data retention on external Iceberg tables


⬆️ Enhancements

🔧 Bug Fixes

  • Non-Sync jobs reading from Apache Iceberg with an interval that is larger than 1 minute did not read all data from the source table

  • Jobs writing to Hive tables with an interval equal to or larger than 7 days could get stuck unless extra configuration was done by Upsolver support

  • Fixed a bug that prevented a job writing to a table with an end time from being marked as Completed when the end time was reached


New Features

🔧 Bug Fixes

  • Minor bug fixes

Last updated