View a markdown version of this page

GpuDevice - Amazon Elastic Container Service

GpuDevice

The state of a GPU on a container instance, including its sharing mode and the memory that's available for new containers.

Contents

containerCount

The number of containers that Amazon ECS assigned to the GPU. This value is 0 when the sharing mode is IDLE and 1 when the sharing mode is DEDICATED. Amazon ECS counts the containers that it assigned to the GPU, not the processes that are running on it.

Type: Integer

Required: No

gpuId

The ID of the GPU. This ID matches the GPU IDs in the gpuIds of the containers that Amazon ECS assigned to the GPU.

Type: String

Required: No

remainingMemoryInMiB

The amount of GPU memory, in MiB, that's available to allocate to new containers that use the nvidiaMps sharing strategy. Amazon ECS calculates this value from the memory that it allocated to containers on the GPU, not from the memory that the containers use.

Type: Integer

Required: No

sharingMode

How the GPU is shared between containers.

Valid values:

  • IDLE - No containers are assigned to the GPU, and all of its memory is available.

  • NVIDIA_MPS - One or more containers share the GPU by using NVIDIA Multi-Process Service (MPS).

  • DEDICATED - One container has exclusive use of the GPU.

Type: String

Valid Values: IDLE | NVIDIA_MPS | DEDICATED

Required: No

totalMemoryInMiB

The total amount of GPU memory, in MiB, that the Amazon ECS container agent reported for the GPU. This is the memory that's available to containers, and it can be less than the nominal memory of the GPU.

Type: Integer

Required: No

See Also

For more information about using this API in one of the language-specific AWS SDKs, see the following: