Consumer Packaged Goods Data Mesh
Publication date: May 11, 2021 (Diagram history)
With this architecture, you can build a data mesh for consumer packaged goods (CPG) companies. Growth in online sales increases the amount of data that business operations generate and maintain. A data mesh follows principles of flexibility and domain-owned design while maintaining data properties throughout the lifecycle. You use AWS Lake Formation for centralized governance and AWS Glue for data cataloging.
For more information about this architecture, see How
to Create a Modern CPG Data Architecture with Data Mesh
CPG data mesh diagram
The following steps describe the architecture:
-
Data flows into AWS through batch processing, real-time streams, and Secure File Transfer Protocol (SFTP).
-
Data sources are managed by the business domain. Consumers and producers use organization-level blueprints that provide core services such as security, governance, IAM roles, and standards.
-
Manage metadata through multiple services. Use AWS Glue for data cataloging. Store data lineage in Amazon Neptune. Store data contracts in Amazon DynamoDB.
-
Consumers search the data by using the contract properties.
-
Lake Formation provides centralized management of fine-grained permissions. It also supports automatic schema discovery and conversion to the required format.
-
Perform ML and analytics by using Lake Formation. This mesh node provides insights and strategy. Use Amazon Athena, Amazon OpenSearch Service, and Amazon SageMaker AI for analysis.
Further reading
For additional information, see the following resources:
Diagram history
To receive updates about this reference architecture diagram, subscribe to the RSS feed.
| Change | Description | Date |
|---|---|---|
Initial publication | Reference architecture diagram first published. | May 11, 2021 |
RSS subscription requirement
To subscribe to RSS updates, you must have an RSS plugin enabled for the browser you are using.
