CREATE CLUSTER

Create a new cluster

Cluster Types

COMPUTE CLUSTER

Jobs are executed on compute clusters. You can create multiple compute clusters with different settings to separate different use cases and workloads.

QUERY CLUSTER

Used for querying Materialized Views in real time. Query clusters host the Materialized Views in memory for millisecond response times.

---

Syntax

CREATE {COMPUTE | QUERY} CLUSTER <cluster_name>
  MIN_INSTANCES = <min_instance_count>
  MAX_INSTANCES = <max_instance_count>
  [COMMENT = '<comment']
  [STATIC_PUBLIC_IPS = <number_of_static_ips>]
  [ON_DEMAND_INSTANCES = <on_demand_instance_count>]
  [MAX_REPLAY_INSTANCES = <max_replay_instance_count>]
  [INSTANCE_TYPE_FAMILY = '<instance_type_family>']
  [SCALING_STRATEGY = {LOW_COST | LOW_LATENCY | CONSISTENT_LOW_LATENCY | NO_SCALING }]
  [ALLOW_MAINTENANCE_ACCESS = {TRUE | FALSE}]

Cluster Options

Connection options

MIN_INSTANCES — editable

Type: int

The lower limit for the number of instances to use when autoscaling the cluster.

MAX_INSTANCES — editable

Type: int

The upper limit for the number of instances to use when autoscaling the cluster.

COMMENT — editable

Type: text

(Optional) A description or comment to associate with the cluster.

STATIC_PUBLIC_IPS — editable

Type: int

(Optional) The number of static IPs to create and associate with the cluster's instances.

ON_DEMAND_INSTANCES — editable

Type: int

(Optional) By default, Upsolver uses ephemeral Spot Instances for data processing. Configure the number of On-Demand Instances in the cluster.

MAX_REPLAY_INSTANCES — editable

Type: int

(Optional) Replay Instances are instances started automatically when new jobs are added to the cluster.

Note: Replay cluster instances operate independently from the main cluster. Consider turning off the replay cluster or using a separate, dedicated cluster if you encounter access issues.

INSTANCE_TYPE_FAMILY — editable

Type: int

(Optional) The instance type family to use. Defaults to 'r5.xlarge'.

SCALING_STRATEGY — editable

Type: enum

(Optional) Defines the scaling policy for the cluster. Defaults to LOW_LATENCY.

ALLOW_MAINTENANCE_ACCESS — editable

Type: Boolean

(Optional) Allows Upsolver Support access to the instances for debugging. Defaults to FALSE.

---

Adjust your cluster creation process based on the type and purpose of your cluster. Both types support the above-listed options and configurations.