The following table describes the important changes to the Amazon MSK Developer Guide.
Latest documentation update: June 25, 2024
| Change | Description | Date |
|---|---|---|
| Express broker feature added. Developer Guide topics reorganized. | MSK supports Standard and new Express brokers. | 2024-11-6 |
| Graviton upgrade in place feature added. |
You can update your cluster broker size from M5 or T3 to M7g, or from M7g to M5. |
2024-6-25 |
| 3.4.0 end of support date announced. | End of support date for Apache Kafka version 3.4.0 is June 17, 2025. | 2024-6-24 |
| Broker removal feature added. |
You can reduce your provisioned cluster’s storage and compute capacity by removing sets of brokers, with no availability impact, data durability risk, or disruption to your data streaming applications. |
2024-5-16 |
WriteDataIdempotently added to AWSMSKReplicatorExecutionRole |
WriteDataIdempotently permission is added to AWSMSKReplicatorExecutionRole policy to support data replication between MSK clusters. |
2024-5-16 |
| Graviton M7g brokers released in Brazil and Bahrain. |
Amazon MSK now supports South America (sa-east-1, São Paulo) and Middle East (me-south-1, Bahrain) region availability of M7g brokers using AWS Graviton processors (custom Arm-based processors built by Amazon Web Services). |
2024-2-07 |
| Release Graviton M7g brokers to China region | Amazon MSK now supports China region availability of M7g brokers using AWS Graviton processors (custom Arm-based processors built by Amazon Web Services). | 2024-01-11 |
| Amazon MSK Kafka version support policy |
Added explanation of the Amazon MSK supported Kafka version support policy. For more information, see Apache Kafka versions. |
2023-12-08 |
| New service execution role policy to support Amazon MSK Replicator. |
Amazon MSK added new |
2023-12-06 |
| M7g Graviton support |
Amazon MSK now supports M7g brokers using AWS Graviton processors (custom Arm-based processors built by Amazon Web Services). |
2023-11-27 |
| Amazon MSK Replicator |
Amazon MSK Replicator is a new feature that you can use to replicate data between Amazon MSK clusters. Amazon MSK Replicator includes an update to the AmazonMSKFullAccess policy. For more information, see AWS managed policy: |
2023-09-28 |
| Updated for IAM best practices. |
Updated guide to align with the IAM best practices. For more information, see Security best practices in IAM. |
2023-03-08 |
| Service-linked role updates to support multi-VPC private connectivity |
Amazon MSK now includes AWSServiceRoleForKafka service-linked role updates to manage network interfaces and VPC endpoints in your account that make cluster brokers accessible to clients in your VPC. Amazon MSK uses permissions to |
2023-03-08 |
| Support for Apache Kafka 2.7.2 |
Amazon MSK now supports Apache Kafka version 2.7.2. For more information, see Supported Apache Kafka versions. |
2021-12-21 |
| Support for Apache Kafka 2.6.3 |
Amazon MSK now supports Apache Kafka version 2.6.3. For more information, see Supported Apache Kafka versions. |
2021-12-21 |
| MSK Serverless Prerelease |
MSK Serverless is a new feature that you can use to create serverless clusters. For more information, see What is MSK Serverless?. |
2021-11-29 |
| Support for Apache Kafka 2.8.1 |
Amazon MSK now supports Apache Kafka version 2.8.1. For more information, see Supported Apache Kafka versions. |
2021-09-30 |
| MSK Connect |
MSK Connect is a new feature that you can use to create and manage Apache Kafka connectors. For more information, see Understand MSK Connect. |
2021-09-16 |
| Support for Apache Kafka 2.7.1 |
Amazon MSK now supports Apache Kafka version 2.7.1. For more information, see Supported Apache Kafka versions. |
2021-05-25 |
| Support for Apache Kafka 2.8.0 |
Amazon MSK now supports Apache Kafka version 2.8.0. For more information, see Supported Apache Kafka versions. |
2021-04-28 |
| Support for Apache Kafka 2.6.2 |
Amazon MSK now supports Apache Kafka version 2.6.2. For more information, see Supported Apache Kafka versions. |
2021-04-28 |
| Support for Updating Broker Type |
You can now change the broker type for an existing cluster. For more information, see Update the Amazon MSK cluster broker size. |
2021-01-21 |
| Support for Apache Kafka 2.6.1 |
Amazon MSK now supports Apache Kafka version 2.6.1. For more information, see Supported Apache Kafka versions. |
2021-01-19 |
| Support for Apache Kafka 2.7.0 |
Amazon MSK now supports Apache Kafka version 2.7.0. For more information, see Supported Apache Kafka versions. |
2020-12-29 |
| No New Clusters with Apache Kafka Version 1.1.1 | You can no longer create a new Amazon MSK cluster with Apache Kafka version 1.1.1. However, if you have existing MSK clusters that are running Apache Kafka version 1.1.1, you can continue using all of the currently-supported features on those existing clusters. For more information, see Apache Kafka versions. | 2020-11-24 |
| Consumer-Lag Metrics |
Amazon MSK now provides metrics that you can use to monitor consumer lag. For more information, see Monitor an Amazon MSK Provisioned cluster. |
2020-11-23 |
| Support for Cruise Control |
Amazon MSK now supports LinkedIn's Cruise Control. For more information, see Use LinkedIn's Cruise Control for Apache Kafka with Amazon MSK. |
2020-11-17 |
| Support for Apache Kafka 2.6.0 |
Amazon MSK now supports Apache Kafka version 2.6.0. For more information, see Supported Apache Kafka versions. |
2020-10-21 |
| Support for Apache Kafka 2.5.1 |
Amazon MSK now supports Apache Kafka version 2.5.1. With Apache Kafka version 2.5.1, Amazon MSK supports encryption in transit between clients and ZooKeeper endpoints. For more information, see Supported Apache Kafka versions. |
2020-09-30 |
| Application Auto-Expansion |
You can configure Amazon Managed Streaming for Apache Kafka to automatically expand your cluster's storage in response to increased usage. For more information, see Automatic scaling for clusters. |
2020-09-30 |
| Support for Username and Password Security |
Amazon MSK now supports logging into clusters using a username and password. Amazon MSK stores credentials in AWS Secrets Manager. For more information, see SASL/SCRAM authentication. |
2020-09-17 |
| Support for Upgrading the Apache Kafka Version of an Amazon MSK Cluster |
You can now upgrade the Apache Kafka version of an existing MSK cluster. |
2020-05-28 |
| Support for T3.small Broker Nodes |
Amazon MSK now supports creating clusters with brokers of Amazon EC2 type T3.small. |
2020-04-08 |
| Support for Apache Kafka 2.4.1 |
Amazon MSK now supports Apache Kafka version 2.4.1. |
2020-04-02 |
| Support for Streaming Broker Logs | Amazon MSK can now stream broker logs to CloudWatch Logs, Amazon S3, and Amazon Data Firehose. Firehose can, in turn, deliver these logs to the destinations that it supports, such as OpenSearch Service. | 2020-02-25 |
| Support for Apache Kafka 2.3.1 |
Amazon MSK now supports Apache Kafka version 2.3.1. |
2019-12-19 |
Open Monitoring |
Amazon MSK now supports open monitoring with Prometheus. |
2019-12-04 |
Support for Apache Kafka 2.2.1 |
Amazon MSK now supports Apache Kafka version 2.2.1. |
2019-07-31 |
General Availability |
New features include tagging support, authentication, TLS encryption, configurations, and the ability to update broker storage. |
2019-05-30 |
Support for Apache Kafka 2.1.0 |
Amazon MSK now supports Apache Kafka version 2.1.0. |
2019-02-05 |
