Elasticsearch

Use the following options to configure jobs writing to Elasticsearch.

Syntax

[ AGGREGATION_PARALLELISM = <integer> ]
[ BULK_MAX_SIZE_BYTES = <integer> ]
[ COMMENT = '<comment>' ]
[ COMPUTE_CLUSTER = <cluster_identifier> ]
[ END_AT = { NOW | timestamp } ]
[ INDEX_PARTITION_SIZE = { DAILY | WEEKLY | MONTHLY | YEARLY | NONE } ]
[ ROUTING_FIELD_NAME = <column_identifier> ]
[ RUN_INTERVAL = <integer> { MINUTE[S] | HOUR[S] | DAY[S] } ]
[ RUN_PARALLELISM = <integer> ]
[ START_FROM = { NOW | BEGINNING | timestamp } ]

Jump to

Elasticsearch job options:

General job options:

Job options

BULK_MAX_SIZE_BYTES — editable

Type: integer

Default: 9

(Optional) The max size of each bulk insert into the index. This option defaults to 9MB.

INDEX_PARTITION_SIZE

Values: { HOURLY | DAILY | MONTHLY | YEARLY | NONE }

Default: DAILY

(Optional) The size of each partition of the index. The default value is DAILY.

To write to a single index name, without partitioning, use NONE

ROUTING_FIELD_NAME

Type: Column Identifier

(Optional) A field name that will be used for setting the routing field in Elasticsearch (_routing).

Last updated