Querying metadata tables
Note
The S3 Metadata feature is in preview release for Amazon S3 and is subject to change.
Amazon S3 Metadata lets you analyze your S3 managed metadata tables with any query engine that supports the Apache Iceberg format. When you integrate your S3 table buckets with AWS analytics services, you can use services like Amazon Athena, Amazon Redshift, and others to help you do the following with your metadata tables:
-
Discover storage usage patterns and trends
-
Audit AWS Key Management Service (AWS KMS) encryption key usage across your objects
-
Search for objects by user-defined metadata and object tags
-
Understand object metadata changes over time
-
Learn when objects are updated or deleted, including the AWS account ID or IP address that made the request
Note
Integrating S3 table buckets with AWS analytics services is in preview release and subject to change.
Once your table buckets are integrated, you can query your metadata tables. This includes joining S3 managed metadata tables and custom metadata tables, allowing you to query across multiple datasets as long as the metadata tables are stored in the same table bucket.
From there, you can create interactive dashboards with your query data by using Amazon QuickSight.
Query pricing considerations
Additional pricing applies for running queries on your metadata tables. For more information, see pricing information for the query engine you're using.
For information on making your queries more cost effective, see Optimizing metadata table query performance.
Topics
