There are several options offered by AWS when configuring a target for a zero-ETL integration. The target may be an encrypted Amazon Redshift data warehouse or an Amazon SageMaker Lakehouse catalog.
Before selecting the target for the zero-ETL integration, you need to configure one of the following target resources.
The configuration options for a target in a zero-ETL integration include:
An Amazon SageMaker Lakehouse catalog and database configured with Amazon S3 storage. See Setting up an AWS Glue database.
An Amazon SageMaker Lakehouse catalog configured with Amazon Redshift managed storage. See Configuring the integration with your target.
An Amazon Redshift data warehouse identified by a Redshift namespace. See Configuring the integration with your target.
Note
You cannot modify the target of a zero-ETL integration after creation.
Configuring the integration with your target
After you have selected your connection and specified a source IAM role, follow these steps when specifying an Amazon Redshift data warehouse target:
Specify the namespace of the Redshift cluster or Redshift Serverless workgroup, or Create a new namespace.
Select the AWS Glue Fix it for me option. For the Redshift target, this will:
Apply an authorized service principal on the Redshift cluster or Serverless workgroup.
Apply an authorized Glue source ARN to the Redshift cluster or Serverless workgroup.
Associate a new parameter group with
enable_case_sensitive_identifier = true.
Provide the integration name and choose Create and Launch Integration.
Once your integration is in the active state, navigate to the integration details page and choose Create a database from integration.
Finally, you can navigate to the Redshift query editor, and connect to your database to validate the snapshot and incremental data.
Note
You can only use lowercase alphanumeric characters and underscores in the namespace or catalog name. This is different from what the AWS Glue Data Catalog allows to create a database with any name (including special characters).
Follow these steps when specifying an Amazon SageMaker Lakehouse catalog and database configured with an Amazon S3 storage target:
Register an integration from Redshift into the catalog in Lake Formation. See Registering Amazon Redshift clusters and namespaces to the AWS Glue Data Catalog.
Create a federated or managed catalog in AWS Lake Formation. For more information, see:
