Setting up Apache Livy for Amazon EMR on EKS
Before you can install Apache Livy on your Amazon EKS cluster, you must install and configure a set of prerequisite tools. These include the AWS CLI, which is a foundational command-line tool for working with AWS resources, command-line tools for working with Amazon EKS, and a controller that's used in this use case to make your cluster application available to the internet and to route network traffic.
-
Install or update to the latest version of the AWS CLI – If you've already installed the AWS CLI, confirm that you have the latest version.
-
Set up kubectl and eksctl – eksctl is a command line tool that you use to communicate with Amazon EKS.
-
Install Helm – The Helm package manager for Kubernetes helps you install and manage applications on your Kubernetes cluster.
-
Get started with Amazon EKS – eksctl – Follow the steps to create a new Kubernetes cluster with nodes in Amazon EKS.
-
Select an Amazon EMR release label – the Apache Livy is supported with Amazon EMR releases 7.1.0 and higher.
-
Install the ALB controller – the ALB controller manages AWS Elastic Load Balancing for Kubernetes clusters. It creates an AWS Network Load Balancer (NLB) when you create a Kubernetes Ingress while setting up Apache Livy.
