Recent Compactions
The recent_compactions system table includes information about the partitions in your Apache Iceberg tables that Upsolver has recently run, or is running, a compaction operation on.
From a worksheet within Upsolver, run the following query:
The system.monitoring.recent_compactions table includes the following columns:
Column | Type | Description |
---|---|---|
catalog | string | The name of the data catalog. |
compacted_file_size_in_bytes | bigint | The size of the compacted files measured in bytes. |
compaction_time | datetime | The time required to run the compaction operation. |
data_files | bigint | The number of data files undergoing compaction. |
data_files_size_in_bytes | bigint | The size of the data files undergoing compaction. |
equality_deletes_files_size_in_bytes | bigint | The total size of Equality Delete Files applied during compaction. |
equality_deletes_files_to_apply | bigint | The number of equality deletes files to apply while compacting the data. Equality deletes files are files that contain delete commands by primary keys. During the compaction deletes files are being handled. |
error | string | The error message encountered during the compaction processes that caused the operation to fail. |
id | string | The unique identifier for the partition. |
partition | string | The unique name for the partition. |
position_deletes_files_size_in-bytes | bigint | The size in bytes of position deletes files applied while compacting the data. |
position_deletes_files_to_apply | bigint | The number of position deletes files to apply while compacting the data. Position deletes files are files that contain delete commands by data file name and index. |
read_rows | bigint | The number of rows to read from the data files. |
schema | schema | The name of the schema that the table belongs to. |
shard | bigint | The shard number used for the compaction. |
status | status | The status of the compaction process: either Completed, Running, or Failed. |
table_name | status | The name of the table that the partition belongs to. |
total_cpu_time_in_seconds | bigint | The CPU time required to perform the compaction operation. |
total_shards | bigint | The total shards required to run the compaction operation on the partition. |
written_rows | bigint | The number of rows written to the output data files during compaction. |
Last updated