Last updated
Last updated
When ingesting data from external applications, Upsolver converts the incoming data into its supported data types. Also, any transformations performed within the data lake will utilize these supported data types:
BOOLEAN
This type captures Boolean values true
and false
.
BIGINT
A 64-bit signed two’s complement integer with a minimum value of -2^63
and a maximum value of 2^63 - 1
.
DOUBLE
A double is a 64-bit inexact, variable-precision implementing the IEEE Standard 754 for Binary Floating-Point Arithmetic.
STRING
Variable length of characters.
DATE
Calendar date (year, month, day).
Example: DATE '2001-08-22'
TIMESTAMP
Instant in time that includes the date and time of day without a time zone. Supported up to milliseconds precision.
Example: TIMESTAMP '2001-08-22 03:04:05.321'
INTERVAL YEAR TO MONTH
Span of years and months.
Note that creating columns of this type are not supported. This is usually used when to create a time interval for filtering purposes.
Example: WHERE partition_date > DATE '2022-08-01' - INTERVAL '3' MONTH
INTERVAL DAY TO SECOND
Span of days, hours, minutes, seconds and milliseconds.
Note that creating columns of this type are not supported. This is usually used when to create a time interval for filtering purposes.
Example: WHERE $commit_time BETWEEN run_start_time() - INTERVAL '2' DAY and run_end_time()
ARRAY
An array of the given component type.
Note that arrays that only contain null values are treated as null
; while for arrays that contain both null and non-null values, Upsolver ignores those null values when working with the array.
Examples: ARRAY[1, 2, 3], [1, 2, 3]