Elasticsearch

Use the following options to configure jobs writing to Elasticsearch.

Syntax
[ AGGREGATION_PARALLELISM = <integer> ]
[ BULK_MAX_SIZE_BYTES = <integer> ]
[ COMMENT = '<comment>' ]
[ COMPUTE_CLUSTER = <cluster_identifier> ]
[ END_AT = { NOW | timestamp } ]
[ INDEX_PARTITION_SIZE = { DAILY | WEEKLY | MONTHLY | YEARLY | NONE } ]
[ ROUTING_FIELD_NAME = <column_identifier> ]
[ RUN_INTERVAL = <integer> { MINUTE[S] | HOUR[S] | DAY[S] } ]
[ RUN_PARALLELISM = <integer> ]
[ START_FROM = { NOW | BEGINNING | timestamp } ]
Jump to
Elasticsearch job options:
​BULK_MAX_SIZE_BYTES​
​INDEX_PARTITION_SIZE​
​ROUTING_FIELD_NAME​
General job options:
​AGGREGATION_PARALLELISM​
​COMMENT​
​COMPUTE_CLUSTER​
​END_AT​
​RUN_INTERVAL​
​RUN_PARALLELISM​
​START_FROM​
Job options
BULK_MAX_SIZE_BYTES — editable
Type: integer
Default: 9
(Optional) The max size of each bulk insert into the index. This option defaults to 9MB.
INDEX_PARTITION_SIZE
Values: { HOURLY | DAILY | MONTHLY | YEARLY | NONE }
Default: DAILY
(Optional) The size of each partition of the index. The default value is DAILY.
To write to a single index name, without partitioning, use NONE
ROUTING_FIELD_NAME
Type:  Column Identifier
(Optional) A field name that will be used for setting the routing field in Elasticsearch (_routing).

Data lake tables

PostgreSQL

Last modified 21d ago

Elasticsearch

Syntax

Jump to

Job options

`BULK_MAX_SIZE_BYTES` — editable

`INDEX_PARTITION_SIZE`

`ROUTING_FIELD_NAME`