ARRAY_DISTINCT
Returns all the distinct elements in the array
Syntax
ARRAY_DISTINCT(input)
Arguments
Name
Type
Description
Default Value
input
any
The values to transform
Returns
an array of distinct values from the input. this function will maintain the order of the input. a primitive input will be considered an array with a single value and will return an array containing that value.
Examples
input
Output
array[1, 2, 3, 4, 4, 1]
[1, 2, 3, 4]
Transformation job example
SQL
CREATE JOB function_operator_example
ADD_MISSING_COLUMNS = true
AS INSERT INTO default_glue_catalog.upsolver_samples.orders_transformed_data
MAP_COLUMNS_BY_NAME
SELECT input[],
ARRAY_DISTINCT(input[]) AS Output
FROM default_glue_catalog.upsolver_samples.orders_raw_data
LET input = array[1, 2, 3, 4, 4, 1]
WHERE $commit_time BETWEEN run_start_time() AND run_end_time()
LIMIT 1;
Query result
input[]
Output
array[1, 2, 3, 4, 4, 1]
[1, 2, 3, 4]
Last updated