ARRAY_DISTINCT

Get all the distinct elements in the array

Syntax

ARRAY_DISTINCT(input)

Arguments

Name	Type	Description	Default Value
input	any	The values to transform

Returns

an array of distinct values from the input. this function will maintain the order of the input. a primitive input will be considered an array with a single value and will return an array containing that value.

Examples

input	Output
array[1, 2, 3, 4, 4, 1]	[1, 2, 3, 4]

Transformation job example

SQL

CREATE JOB function_operator_example
    ADD_MISSING_COLUMNS = true
    AS INSERT INTO default_glue_catalog.upsolver_samples.orders_transformed_data MAP_COLUMNS_BY_NAME
    SELECT input[],
        ARRAY_DISTINCT(input[]) AS Output
    FROM default_glue_catalog.upsolver_samples.orders_raw_data
    LET input = array[1, 2, 3, 4, 4, 1]
    WHERE time_filter()
    LIMIT 1;

Query result

input[]	Output
array[1, 2, 3, 4, 4, 1]	[1, 2, 3, 4]