October 2023

Upsolver new features, enhancements, and bug fixes for October 2023.

Release Notes Blog

For more detailed information on these updates, check out the Upsolver November 2023 Feature Summary blog.

Weekly Software Updates

The following software updates were released in October:

2023.10.30-11.38

⬆️ Enhancements

• Added KEEP_REPLICATION_SLOT option to ingestion and replication jobs that read from PostgreSQL. This preserves the replication slot created when the job is dropped.

---

2023.10.25-10.43

✨ New Features

• Running queries can now be stopped via the UI with a new Cancel button next to a running query in the Event Log.

• Running queries in Upsolver's Query Engine can now be stopped using the following new SQL syntax: ABORT QUERY <query_id>.
• You can now see what queries are running in Upsolver's Query Engine by querying the system.monitoring.running_queries table.

🔧 Bug Fixes

• Fixed inconsistent catalog names in system.insights tables for Snowflake outputs.
• Fixed an issue where FLATTEN_PATH wasn't case insensitive with columns from a SELECT * statement.

---

2023.10.17-17.45

🔧 Bug Fixes

• Jobs: Fixed an issue causing NULL values when casting raw columns to multiple different types in the same query.

---

2023.10.11-11.26

✨ New Features

• Added two new system tables for viewing written column statistics: system.insights.dataset_column_stats and system.insights.job_output_column_stats.

• Enabled integrating monitoring data from Upsolver into third-party systems to ensure reliability and performance of data pipelines:

  • Support for Amazon CloudWatch

  • Support for Datadog

⬆️ Enhancements

• Improved query performance when selecting from the system.monitoring.jobs table.

---

2023.10.02-07.15

✨ New Features

• New function added: REGEXP_EXTRACT.
• Allow the creation of a new cloud integration on a new organization.

• Ingestion wizard: now supports Confluent Cloud as a source.

• Ingestion jobs: now supports Amazon S3 via SQS.

⬆️ Enhancements

• Apache Kafka and Confluent Kafka connections: support setting SASL username and password with dedicated parameters SASL_USERNAME and SASL_PASSWORD.

• UI design improvements.

🔧 Bug Fixes

• When editing the number of shards in an Apache Kafka output job, Upsolver waits until the previous shards are completed before running the new shards.

• Fixed an issue of Query engine request timed out.