Containers with custom inference code - Amazon SageMaker AI

Containers with custom inference code

You can use Amazon SageMaker AI to interact with Docker containers and run your own inference code in one of two ways:

  • To use your own inference code with a persistent endpoint to get one prediction at a time, use SageMaker AI hosting services.

  • To use your own inference code to get predictions for an entire dataset, use SageMaker AI batch transform.