View a markdown version of this page

Installing KubeRay on HyperPod Amazon EKS - Amazon SageMaker AI

Installing KubeRay on HyperPod Amazon EKS

The KubeRay operator manages the lifecycle of RayCluster, RayJob, RayCronJob, and RayService resources. It is required for every Ray capability on HyperPod. HyperPod uses the open source operator without any changes.

Prerequisites

Installing on an existing cluster

If your cluster does not already run KubeRay, install the operator with Helm.

To install the KubeRay operator
  1. Add the KubeRay Helm repository.

    helm repo add kuberay https://ray-project.github.io/kuberay-helm/ helm repo update
  2. Install the operator.

    helm install kuberay-operator kuberay/kuberay-operator
  3. Confirm that the operator pod is running.

    kubectl get pods -l app.kubernetes.io/name=kuberay-operator

For more information about operator installation options, see KubeRay operator installation in the Ray documentation.

Upgrading and uninstalling

Upgrade the operator to the latest chart version:

helm repo update helm upgrade kuberay-operator kuberay/kuberay-operator

Uninstalling removes the operator but not your Ray custom resources:

helm uninstall kuberay-operator
Warning

Uninstalling the operator stops reconciliation of every Ray resource in the cluster. Running Ray clusters continue but are no longer managed, and deletions do not complete. Delete your Ray resources before you uninstall.