This article maps out a simple Upsolver use case where an S3 data source is turned into an Athena output.
A very typical simple use case is when you have a stream of data you want to query using Amazon Athena, with the events sent to the output as they arrive from the data source.
It is very common to partition the data by the date/time of the event (and not the date/time that the event arrived). This ensures that events that might arrive late are stored in the correct partitions, and it also means that when you query the data, only the relevant folders are queried, improving performance.
For this example, we use a demo Amazon S3 data source called Resource Utilization, which is a simple stream of data that is not nested.