View and monitor an Amazon EMR cluster as it performs work
Amazon EMR provides several tools you can use to gather information about your cluster. You can access information about the cluster from the console, the CLI or programmatically. The standard Hadoop web interfaces and log files are available on the primary node. You can also use monitoring services such as CloudWatch and Ganglia to track the performance of your cluster.
Application history is also available from the console using the "persistent" application UIs for Spark History Server starting with Amazon EMR 5.25.0. With Amazon EMR 6.x, persistent YARN timeline server, and Tez user interfaces are also available. These services are hosted off-cluster, so you can access application history for 30 days after the cluster terminates, without the need for a SSH connection or web proxy. See View application history.
Topics
- View Amazon EMR cluster status and details
- Enhanced step debugging with Amazon EMR
- View Amazon EMR application history
- View Amazon EMR log files
- View cluster instances in Amazon EC2
- CloudWatch events and metrics from Amazon EMR
- View cluster application metrics using Ganglia with Amazon EMR
- Logging AWS EMR API calls using AWS CloudTrail