Links
Comment on page

ARRAY_DISTINCT

Get all the distinct elements in the array

Syntax

ARRAY_DISTINCT(input)

Arguments

Name
Type
Description
Default Value
input
any
The values to transform

Returns

an array of distinct values from the input. this function will maintain the order of the input. a primitive input will be considered an array with a single value and will return an array containing that value.

Examples

input
Output
array[1, 2, 3, 4, 4, 1]
[1, 2, 3, 4]

Transformation job example

SQL

CREATE JOB function_operator_example
ADD_MISSING_COLUMNS = true
AS INSERT INTO default_glue_catalog.upsolver_samples.orders_transformed_data MAP_COLUMNS_BY_NAME
SELECT input[],
ARRAY_DISTINCT(input[]) AS Output
FROM default_glue_catalog.upsolver_samples.orders_raw_data
LET input = array[1, 2, 3, 4, 4, 1]
WHERE time_filter()
LIMIT 1;

Query result

input[]
Output
array[1, 2, 3, 4, 4, 1]
[1, 2, 3, 4]