Inference

Once you've created a cluster using the steps in Amazon EKS Setup, you can use it to run inference jobs. For inference, you can use either a CPU or GPU example depending on the nodes in your cluster. Inference supports only single node configurations. The following topics show how to run inference with AWS Deep Learning Containers on EKS using PyTorch, and TensorFlow.