Connectors
Before starting to create your data pipeline with Upsolver, you should ensure that you have the necessary connectors in place to support your desired use case.
For data ingestion, you first need a connection with your data source; then in order to read your data into a staging table, you should have a connection with a metadata store along with a corresponding cloud storage location.
Once your data has been ingested and transformed as desired, you need a connection with your target location in order to output your data.
Note: If you have deployed Upsolver on AWS, you will have an S3 and Glue Catalog connection created by default.
However, since connections determine the credentials Upsolver uses to read and/or write your data, you may still wish to explicitly create your own S3 or Glue Catalog connections to configure specific permissions.
Last modified 2mo ago