Supported framework images, AWS Regions, and instance types
This feature supports the following machine learning frameworks and AWS Regions.
Note
To use this feature, make sure that you have installed the SageMaker Python SDK version 2.180.0
SageMaker AI framework images pre-installed with SageMaker Profiler
SageMaker Profiler is pre-installed in the following AWS Deep Learning Containers for SageMaker AI
PyTorch images
PyTorch versions | AWS DLC image URI |
---|---|
2.2.0 |
|
2.1.0 |
|
2.0.1 |
|
1.13.1 |
|
TensorFlow images
TensorFlow versions | AWS DLC image URI |
---|---|
2.13.0 |
|
2.12.0 |
|
2.11.0 |
|
Important
Distribution and maintenance of the framework containers in the preceding
tables are under the Framework Support Policy managed by the AWS Deep Learning
Containers service. We highly recommend you to upgrade to the currently
supported framework versions
Note
If you want to use SageMaker Profiler for other framework images or your own Docker images, you can install SageMaker Profiler using the SageMaker Profiler Python package binary files provided in the following section.
SageMaker Profiler Python package binary files
If you want to configure your own Docker container, use SageMaker Profiler in other pre-built containers for PyTorch and TensorFlow, or install the SageMaker Profiler Python package locally, use one the following binary files. Depending on the Python and CUDA versions in your environment, choose one of the following.
PyTorch
-
Python3.8, CUDA 11.3:
https://smppy.s3.amazonaws.com/pytorch/cu113/smprof-0.3.334-cp38-cp38-linux_x86_64.whl
-
Python3.9, CUDA 11.7:
https://smppy.s3.amazonaws.com/pytorch/cu117/smprof-0.3.334-cp39-cp39-linux_x86_64.whl
-
Python3.10, CUDA 11.8:
https://smppy.s3.amazonaws.com/pytorch/cu118/smprof-0.3.334-cp310-cp310-linux_x86_64.whl
-
Python3.10, CUDA 12.1:
https://smppy.s3.amazonaws.com/pytorch/cu121/smprof-0.3.334-cp310-cp310-linux_x86_64.whl
TensorFlow
For more information about how to install SageMaker Profiler using the binary files, see (Optional) Install the SageMaker Profiler Python package.
Supported AWS Regions
SageMaker Profiler is available in the following AWS Regions.
-
US East (N. Virginia) (
us-east-1
) -
US East (Ohio) (
us-east-2
) -
US West (Oregon) (
us-west-2
) -
Europe (Frankfurt) (
eu-central-1
) -
Europe (Ireland) (
eu-west-1
)
Supported instance types
SageMaker Profiler supports profiling of training jobs on the following instance types.
CPU and GPU profiling
-
ml.g4dn.12xlarge
-
ml.g5.24xlarge
-
ml.g5.48xlarge
-
ml.p3dn.24xlarge
-
ml.p4de.24xlarge
-
ml.p4d.24xlarge
-
ml.p5.48xlarge
GPU profiling only
-
ml.g5.2xlarge
-
ml.g5.4xlarge
-
ml.g5.8xlarge
-
ml.g5.16.xlarge