AWS Glue Data Catalog
Last updated
Last updated
This section outlines how to configure AWS Glue Data Catalog access in Upsolver. Setting up AWS Glue access in Upsolver facilitates effective data management and processing.
To set up AWS Glue Data Catalog in Upsolver, an IAM role with the appropriate permissions is required. Follow the AWS documentation to create an IAM role and establish a trust relationship.
Upsolver needs these permissions for integrating with AWS Glue:
glue:GetDatabase
glue:GetTable
glue:GetPartition
glue:GetPartitions
glue:GetUserDefinedFunction
glue:CreateDatabase
: Create new databases in the AWS Glue Catalog
glue:UpdateDatabase
: Update existing databases
glue:DeleteDatabase
: Delete databases
glue:CreateTable
: Create new tables
glue:UpdateTable
: Update existing tables
glue:DeleteTable
: Delete tables
glue:BatchCreatePartition
: Create multiple partitions simultaneously
glue:BatchDeletePartition
: Delete multiple partitions simultaneously
When creating an AWS Glue connection in Upsolver, specify the AWS Glue Data Catalog and database for Upsolver to access and manage data structures.
Create an IAM policy with the following statements to grant Upsolver access to AWS Glue resources. Replace <database_name>
with your actual database name:
{
"Version": "2012-10-17",
"Statement": [
{
"Effect": "Allow",
"Action": [
"glue:GetDatabase",
"glue:GetTable",
"glue:GetPartition",
"glue:GetPartitions",
"glue:GetUserDefinedFunction"
"glue:CreateDatabase",
"glue:UpdateDatabase",
"glue:DeleteDatabase",
"glue:CreateTable",
"glue:UpdateTable",
"glue:DeleteTable",
"glue:BatchCreatePartition",
"glue:BatchDeletePartition"
],
"Resource": [
"arn:aws:glue:<region>:<account-id>:database/<database_name>",
"arn:aws:glue:<region>:<account-id>:table/<database_name>/*",
"arn:aws:glue:<region>:<account-id>:catalog"
]
}
]
}
This policy allows Upsolver to perform read and write operations in the specified AWS Glue Data Catalog.
Learn More
For detailed information on AWS Glue permissions and integration with Upsolver, refer to Amazon's AWS Glue documentation.