LogoLogo
OverviewQuickstartsHow To GuidesReferenceArticlesSupport
Support
Support
  • Support
  • FAQs
    • Get Started with Upsolver
    • Basic Elements of Upsolver
    • Iceberg Cloud Storage Breakdown
    • Infrastructure
    • Cost Estimator
  • TROUBLESHOOTING
    • AWS Configuration
      • CloudFormation Stack Failed to Deploy
      • Private API Doesn't Start or Can't Connect
        • Elastic IPs Limit Reached
        • EC2 Spot Instance Not Running
        • DNS Cache
        • Security Group Not Open
    • Cluster
      • Compute Cluster Doesn't Start
      • Can't Connect to Apache Kafka Cluster
    • Jobs
      • Problem Ingesting Amazon S3 Data
      • Data Doesn't Appear in Athena Table
      • Exception When Querying Athena Table
  • ERROR MESSAGES
    • Error Messages
      • Cluster
        • UP10020 COMPUTE_CLUSTER is Missing
      • Jobs
        • UP10010 Missing ON Condition
        • UP10030 Entity Already Exists
        • UP10040 Entity Not Found
        • UP10050 Materialized View Illegal Column Expression
        • UP10060 Statement Parsing
        • UP10100 Cannot Select Records in an UNNEST Statement
        • UP20010 Source Data Not Found
        • UP20040 Could Not DROP Entity Used by a Job or Materialized View
      • Replication
        • UP20050 Reached PostgreSQL Replication Slots Limit
        • UP20051 PostgreSQL Replication is Disabled
      • Security
        • UP20020 No Access to Database
        • UP20030 No Permissions to assumeRole
        • UP20060 Unable to Connect
        • UP20061 Unable to Connect to a Private Network
Powered by GitBook
On this page
  1. FAQs

Basic Elements of Upsolver

Learn the fundamentals of using Upsolver to ingest your data.

CtrlK
  • Should I code pipelines from scratch?
  • What are Templates?
  • What are Worksheets?
  • What's the difference between private and public Worksheets?
  • What elements are in a Worksheet?
  • What is the Jobs section?
  • What is a Job?
  • What is the Clusters section?
  • What is Upsolver's compute cluster?
  • What is Upsolver's API server?
  • Where can I learn more about using Upsolver?
  • What is stream ordering in Upsolver pipelines?

Upsolver has been designed to help you build pipelines quickly and easily. Read the following FAQs to discover the basic elements of Upsolver.

Should I code pipelines from scratch?

Upsolver includes pipeline templates to help you get started with popular use cases, however, you can also use SQL snippets to build your own pipelines if you prefer. Templates are available under the Worksheets section, or you create a blank worksheet to write your own code.


What are Templates?

Pre-built templates help you to jump-start your Upsolver journey. Use templates with sample data to create a worksheet and start ingesting data. Templates include code to create data sources and target connections, tables, and jobs.


What are Worksheets?

Worksheets provide an interface for creating and submitting SQL queries, as well as performing most other DML and all DDL operations, and viewing the results as your statements complete.


What's the difference between private and public Worksheets?

In Upsolver, you will find worksheets that are:

  • Private - only accessible to you.

  • Public - visible and accessible to all users within your organization.


What elements are in a Worksheet?

The worksheet contains data source and target connections, tables, and jobs, written in familiar SQL syntax.


What is the Jobs section?

The Jobs section in Upsolver provides insights into each job and its progress. The Jobs page is helpful for monitoring and troubleshooting your jobs.


What is a Job?

Jobs enable you to copy and transform your data. They can read from external sources and write the data into a table, or read from a table and write to another table or an external target.


What is the Clusters section?

The clusters section in the Upsolver UI provides a list of the clusters in your Upsolver environment.


What is Upsolver's compute cluster?

The compute cluster is the group of servers that provide the computing power for transforming, aggregating, and enriching the data in Upsolver. They don’t interact with outside processes.


What is Upsolver's API server?

Every time a user triggers an action that requires a response, the request interacts with the API Server.


Where can I learn more about using Upsolver?

We have a library of resources, including articles, videos, blogs, and whitepapers on our website: https://www.upsolver.com/resources.


What is stream ordering in Upsolver pipelines?

Upsolver handles data stream ordering based on the following rules:

  • The ordering within each partition or shard is preserved, as long as the number of output shards is equal to or lower than the number of input shards

  • Data is read based on the Select statement

    • If a Union operator is used in the statement, the data sources will be processed based on the order in which they appear within the Union (standard ANSI SQL behavior).