August 2023
Upsolver new features, enhancements, and bug fixes for August 2023.
Weekly Software Updates
The following software updates were released in August:
2023.08.29-15.15
Snowflake:
SELECT *
will preserve the original case of field names in variant columns.Performance Improvement: Reduce the number of file operations when coordinating future table operations.
Write
Timestamp
andDate
types as ISO-8601 strings in jobs that write to Elasticsearch.
Jobs: When using
MAP_COLUMNS_BY_NAME
, theEXCEPT
columns list was fixed to be case-insensitive
2023.08.17-13.30
Write
Timestamp
andDate
types as ISO-8601 strings in string output jobs, for example: Job to Elasticsearch, Job to Amazon S3 with format JSON/CSV.Write
Timestamp
andDate
types as ISO-8601 inRECORD_TO_JSON
function.
Performance improvements in CDC jobs.
Performance improvements when querying the Upsolver Query Engine.
2023.08.16-07.42
Users can now omit the connection type when specifying a source or target in jobs (e.g.
INSERT INTO S3 catalog LOCATION = '...'
can be replaced inINSERT INTO catalog LOCATION = '...'
).Improved the performance of CDC jobs reading from databases with a large number of tables.
Querying the information schema tables now returns Jobs and Materialized Views in deleting state.
Elasticsearch Jobs:
MERGE jobs now support deleting documents by using the
WHEN MATCHED AND
...THEN DELETE
syntax.
Upgraded Avro and Parquet libraries to the latest versions.
Major improvements when reading from a table with a large number of partitions.
2023.08.02-01.57
CDC Jobs:
Elasticsearch Jobs:
Support deleting documents with MERGE jobs.
Last updated