Packaging your code into images for machine learning products in AWS Marketplace - AWS Marketplace

Packaging your code into images for machine learning products in AWS Marketplace

Machine learning products in AWS Marketplace use Amazon SageMaker AI to create and run the machine learning logic you provide for buyers. SageMaker AI runs Docker container images that contain your logic. SageMaker AI runs these containers in a secure and scalable infrastructure. For more information, see Security and intellectual property with Amazon SageMaker AI. The following sections provide information about how to package your code into Docker container images for SageMaker AI.

Which type of container image do I create?

The two types of container images are an inference image and a training image.

To create a model package product, you need only an inference image. For detailed instructions, see Creating model package images.

To create an algorithm product, you need both training and inference images. For detailed instructions, see Creating algorithm images.

To package code properly into a container image, the container must adhere to the SageMaker AI file structure. The container must expose the correct endpoints to ensure that the service can pass data to and from your container. The following sections explain the details of this process.

Important

For security purposes, when a buyer subscribes to your containerized product, the Docker containers run in an isolated environment without an internet connection. When you create your containers, don't rely on outgoing calls over the internet because they will fail. Calls to AWS services will also fail. For more information, see the Security and intellectual property with Amazon SageMaker AI section.

Optionally, when creating your inference and training images, use a container from Available Deep Learning Containers Images as a starting point. The images are already properly packaged with different machine learning frameworks.