Data Types

When ingesting data from external applications, Upsolver converts the incoming data into its supported data types. Also, any transformations performed within the data lake will utilize these supported data types:

• Boolean

• Integer

• Floating-point

• String

• Date and time

• Structural

Boolean

BOOLEAN

This type captures Boolean values true and false.

Integer

BIGINT

A 64-bit signed two’s complement integer with a minimum value of -2^63 and a maximum value of 2^63 - 1.

Floating-point

DOUBLE

A double is a 64-bit inexact, variable-precision implementing the IEEE Standard 754 for Binary Floating-Point Arithmetic.

String

STRING

Variable length of characters.

Date and time

DATE

Calendar date (year, month, day).

Example: DATE '2001-08-22'

TIMESTAMP

Instant in time that includes the date and time of day without a time zone. Supported up to milliseconds precision.

Example: TIMESTAMP '2001-08-22 03:04:05.321'

INTERVAL YEAR TO MONTH

Span of years and months.

Note that creating columns of this type are not supported. This is usually used when to create a time interval for filtering purposes.

Example: WHERE partition_date > DATE '2022-08-01' - INTERVAL '3' MONTH

INTERVAL DAY TO SECOND

Span of days, hours, minutes, seconds and milliseconds.

Note that creating columns of this type are not supported. This is usually used when to create a time interval for filtering purposes.

Example: WHERE $commit_time BETWEEN run_start_time() - INTERVAL '2' DAY and run_end_time()

Structural

ARRAY

An array of the given component type.

Note that arrays that only contain null values are treated as null; while for arrays that contain both null and non-null values, Upsolver ignores those null values when working with the array.

Examples: ARRAY[1, 2, 3], [1, 2, 3]