Output to an Amazon S3 bucket
Ensure that you have an Amazon S3 connection with the correct permissions to write to your target bucket.
Once you have fulfilled the prerequisites, you can create an
INSERT
job as follows:This example only demonstrates an example of all job options available when writing to Amazon S3.
Depending on your use case, you may want to configure a different set of options. For example, set the
FILE_FORMAT
to Parquet or the COMPRESSION
to SNAPPYFor the full list of job options with syntax and detailed descriptions, see: Amazon S3 transformation job options
Certain job options are considered mutable, meaning that in some cases, you can run a SQL command to alter an existing transformation job rather than having to create a new one.
For example, take the job we created as an example earlier:
If you wanted to keep the job as is but just change the cluster that is running the job, you can run the following command:
ALTER JOB insert_into_s3
SET COMPUTE_CLUSTER = high_memory_cluster;
Note that some options such as
RUN_INTERVAL
or the FILE_FORMAT
cannot be altered once the connection has been created.