LogoLogo
OverviewQuickstartsHow To GuidesReferenceArticlesSupport
How To Guides
How To Guides
  • How To Guides
  • SETUP
    • Deploy Upsolver on AWS
      • Deployment Guide
      • AWS Role Permissions
      • VPC Peering Guide
      • Role-Based AWS Credentials
    • Enable API Integration
    • Install the Upsolver CLI
  • CONNECTORS
    • Create Connections
      • Amazon Kinesis
      • Amazon Redshift
      • Amazon S3
      • Apache Kafka
      • AWS Glue Data Catalog
      • ClickHouse
      • Confluent Cloud
      • Elasticsearch
      • Microsoft SQL Server
      • MongoDB
      • MySQL
      • PostgreSQL
      • Snowflake
      • Tabular
    • Configure Access
      • Amazon Kinesis
      • Amazon S3
      • Apache Kafka
      • AWS Glue Data Catalog
      • Confluent Kafka
    • Enable CDC
      • Microsoft SQL Server
      • MongoDB
      • MySQL
      • PostgreSQL
  • JOBS
    • Basics
      • Real-time Data Ingestion — Amazon Kinesis to ClickHouse
      • Real-time Data Ingestion — Amazon S3 to Amazon Athena
      • Real-time Data Ingestion — Apache Kafka to Amazon Athena
      • Real-time Data Ingestion — Apache Kafka to Snowflake
    • Advanced Use Cases
      • Build a Data Lakehouse
      • Enriching Data - Amazon S3 to ClickHouse
      • Joining Data — Amazon S3 to Amazon Athena
      • Upserting Data — Amazon S3 to Amazon Athena
      • Aggregating Data — Amazon S3 to Amazon Athena
      • Managing Data Quality - Ingesting Data with Expectations
    • Database Replication
      • Replicate CDC Data into Snowflake
      • Replicate CDC Data to Multiple Targets in Snowflake
      • Ingest Your Microsoft SQL Server CDC Data to Snowflake
      • Ingest Your MongoDB CDC Data to Snowflake
      • Handle PostgreSQL TOAST Values
    • VPC Flow Logs
      • Data Ingestion — VPC Flow Logs
      • Data Analytics — VPC Flow Logs
    • Job Monitoring
      • Export Metrics to a Third-Party System
    • Data Observability
      • Observe Data with Datasets
  • DATA
    • Query Upsolver Iceberg Tables from Snowflake
  • APACHE ICEBERG
    • Analyze Your Iceberg Tables Using the Upsolver CLI
    • Optimize Your Iceberg Tables
Powered by GitBook
On this page
  • Glossary
  • Create the VPC peering
  • Alter the route tables
  • Identifying the correct routing tables to modify
  • Altering the route tables
  • Alter security groups
  1. SETUP
  2. Deploy Upsolver on AWS

VPC Peering Guide

This article describes the steps necessary to implement VPC peering in AWS.

Last updated 11 months ago

This article provides a guide on the steps necessary to implement VPC peering in AWS.

In order to connect to other EC2 resources (e.g. Kafka, databases, etc.), you need to peer the VPC in which the resources are allocated and the private VPC created by the integration.

To peer the VPC, you need to:

Glossary

Your VPC - The VPC containing your resources that you want Upsolver to be able to connect to

Upsolver Private VPC - The VPC Upsolver is deployed in. By default this will be a new VPC created by the integration process for Upsolver.

Create the VPC peering

1. In the navigation pane, select Peering Connections.

2. Click Create Peering Connection and fill in the form.

3. Give the peering connection name a meaningful name (e.g. Upsolver to Kafka).

4. Select your VPC as the requester.

5. Select Upsolver Private VPC as the accepter.

6. Submit the form and click OK.

7. Right-click the new VPC Peering Connection and then click Accept Request.

Follow the on-screen instructions to accept the request.

Alter the route tables

To enable the VPCs to access one another, it is necessary to alter the route tables in both VPCs.

It is important to identify the correct route tables to alter. A VPC has a default route table which acts as the routing table for any subnet in that VPC that has not been explicitly assigned a different routing table. As a result, you may not just edit the default rout table, you need to check which route tables are being used by the subnets.

Identifying the correct routing tables to modify

  1. This will filter all the tabs on the left and allow us to easily find the routing tables we should modify.

  2. Click on the Subnets tab.

  3. Locate the subnets that are being used by Upsolver / your resources.

  4. Write down the routing tables you identify this way. These are the routing tables we will need to modify. Typically you will only have one per VPC to modify, but complex VPC setups may have more.

Altering the route tables

  1. In the navigation pane, click Route Tables.

  2. For each route table you wrote down in the previous step

    1. Locate and select your VPC’s route table.

    2. In the details pane, click Routes > Edit Routes

    3. Click Add Route and enter the details below:

Field
Details

Destination

Enter the Upsolver VPC IPv4 CIDR.

Target

Select Peering connection and choose the connection.

4. Submit the form and click Close.

5. Repeat these steps, this time altering the route tables of the Upsolver Private VPC to include routing to your destination VPC (in step 2.3 fill in your VPC IPv4 CIDR.)

Alter security groups

Now that the VPCs are peered, you need to alter the security groups of your instances to allow inbound and outbound connections from the Upsolver Private VPC.

2. Ensure the correct region is selected in the navigation pane.

3. Click Instances in the navigation pane.

4. Locate your instances and find a suitable security group or attach a new security group to all of the instances accessible to Upsolver Private VPC.

5. Navigate to the security group by selecting the group in the details pane.

6. Click Inbound > Edit.

7. Add a rule with the details below:

Field
Details

Type

All Traffic.

Source

Custom; enter Upsolver Private VPC IPv4 CIDR in the text box.

Description

Upsolver Private VPC.

If you know the specific ports that should be accessible to Upsolver Private VPC, you can customize the rule.

8. If there is no shared security group between all the instances, repeat steps 5-7 for all the security groups needed.

In the navigation pane fill in the Filter By VPC text box:

For each subnet, click on it and then click on Route Table to see the routing table associated with the subnet:

1. Navigate to .

AWS EC2 Dashboard
Create VPC peering
Alter the route tables
Alter security groups