Search results

    Edit on GitHub

    Amazon Redshift Output

    Amazon Redshift is a fully managed Data Warehouse by Amazon which allows one to query their data using standard SQL queries. Upsolver supports exporting your processed data into Redshift for you. Upsolver will export your data in batches to ensure good performance of loads into Redshift, you can select this batch interval when creating your output.

    Creating A New Amazon Redshift Output

    First, ensure you have a table ready in Amazon Redshift which you would like to export to, then follow these steps:

    1. In the Outputs tab click Add Output.
    2. Give the output a name in the Name field and optionally provide a description for this output in Description field.
    3. If you want to aggregate your data (see Aggregating Data) check the Aggregate Data checkbox.
    4. In the Data Source drop down menu select the Data Source you would like to create this output from. If you do not yet have a Data Source you can create one from this menu.
    5. In the Output To menu select Amazon Redshift.
    6. In the Connection menu select the connection to the Redshift Cluster you would like to export to. If you have not yet configured a connection you can create one from this menu. Make sure the user provided has Read and Write permissions for the relevant table.
    7. Click Next.
    8. In the Schema field select the schema in your database which contains the table you would like to export to.
    9. In the Table field select the table you would like to export data to.
    10. In the S3 Connection select the connection to the S3 bucket where you would like Upsolver to store the batch files to load into Redshift.
    11. If you would like to have the files written to a certain prefix within the bucket you provided, type that prefix in the Path field.
    12. Click Next.
    13. You will now see a list of all the columns in that table, you can configure which field gets mapped to each column in the same manner described in Configuring Schema And Filters. Optionally you can also add filters to limit the data exported to Redshift.
    14. When ready, start running your output.