Elasticsearch
Use the following options to configure jobs writing to Elasticsearch.
[ AGGREGATION_PARALLELISM = <integer> ]
[ BULK_MAX_SIZE_BYTES = <integer> ]
[ COMMENT = '<comment>' ]
[ COMPUTE_CLUSTER = <cluster_identifier> ]
[ END_AT = { NOW | timestamp } ]
[ INDEX_PARTITION_SIZE = { DAILY | WEEKLY | MONTHLY | YEARLY | NONE } ]
[ ROUTING_FIELD_NAME = <column_identifier> ]
[ RUN_INTERVAL = <integer> { MINUTE[S] | HOUR[S] | DAY[S] } ]
[ RUN_PARALLELISM = <integer> ]
[ START_FROM = { NOW | BEGINNING | timestamp } ]
Elasticsearch job options:
General job options:
Type:
integer
Default:
9
(Optional) The max size of each bulk insert into the index. This option defaults to 9MB.
Values:
{ HOURLY | DAILY | MONTHLY | YEARLY | NONE }
Default:
DAILY
(Optional) The size of each partition of the index. The default value is
DAILY
.To write to a single index name, without partitioning, use
NONE
Type:
Column Identifier
(Optional) A field name that will be used for setting the routing field in Elasticsearch (
_routing
).Last modified 21d ago