Creating metadata table configurations

To create a metadata table configuration

Before you create a metadata table configuration, make sure that you've reviewed and met the prerequisites and that you've reviewed Metadata table limitations and restrictions.

1. Sign in to the AWS Management Console and open the Amazon S3 console at https://console.aws.amazon.com/s3/.

2. In the left navigation pane, choose General purpose buckets.

3. Choose the general purpose bucket that you want to create a metadata table configuration for.

   Note

   Make sure that this general purpose bucket is an AWS Region where table buckets are available. Table buckets are available only in the US East (N. Virginia), US East (Ohio), and US West (Oregon) Regions.

4. On the buckets' details page, choose the Metadata tab.

5. On the Metadata tab, choose Create metadata configuration.

6. On the Create metadata configuration page, under Destination table bucket, specify a table bucket to store your metadata table in. The table bucket must be in the same AWS account and AWS Region as your general purpose bucket.

   If you don't already have a table bucket, choose Create table bucket. Table bucket names must be 3 to 63 characters and unique within your AWS account in the AWS Region that you've chosen. Valid characters are a-z, 0-9, and hyphens (-). For more information about creating a table bucket, see Creating table buckets.

   When you create your table bucket, make sure that you integrate it with AWS Glue Data Catalog. For more information, see Querying metadata tables with AWS analytics services.

7. For Metadata table name, specify the name that you want your table to have. The metadata table name must be between 1 and 255 characters and unique within the aws_s3_metadata namespace in your table bucket. Valid characters are lowercase letters, numbers, and underscores (_).

8. Choose Create metadata table configuration.

To create a metadata table configuration by using the AWS CLI

Before you create a metadata table configuration, make sure that you've reviewed and met the prerequisites and that you've reviewed Metadata table limitations and restrictions.

To use the following example commands, replace the user input placeholders with your own information.

1. If you don't already have a table bucket, use the following command to create a table bucket to store your metadata table in. Make sure the table bucket is in the same AWS Region as the general purpose bucket that you want to create a metadata table configuration for.

   aws s3tables create-table-bucket --name amzn-s3-demo-bucket --region us-east-2

2. To verify that your table bucket has been created, use the following command:

   aws s3tables list-table-buckets --region us-east-2

3. Create a JSON file that contains your metadata table configuration, and save it (for example, metadata-config.json). The following is a sample configuration.

   Table bucket names must be 3 to 63 characters and unique within your AWS account in the AWS Region that you've chosen. Valid characters are a-z, 0-9, and hyphens (-). For more information about creating a table bucket, see Creating table buckets.

   The metadata table name must be between 1 and 255 characters and unique within the aws_s3_metadata namespace in your table bucket. Valid characters are lowercase letters, numbers, and underscores (_).

   {
     "S3TablesDestination": {
       "TableBucketArn": "arn:aws:s3tables:us-east-2:111122223333:bucket/amzn-s3-demo-bucket",
       "TableName": "test_metadata_table"
     }
   }

4. Use the following command to apply the metadata table configuration to your general purpose bucket (for example, amzn-s3-demo-source-bucket):

   aws s3api create-bucket-metadata-table-configuration \
   --bucket amzn-s3-demo-source-bucket \
   --metadata-table-configuration  file://./metadata-config.json \
   --region us-east-2

5. To verify that the configuration was created, use the following command:

   aws s3api get-bucket-metadata-table-configuration \
   --bucket amzn-s3-demo-source-bucket \
   --region us-east-2