GpuDevice
The state of a GPU on a container instance, including its sharing mode and the memory that's available for new containers.
Contents
- containerCount
-
The number of containers that Amazon ECS assigned to the GPU. This value is
0when the sharing mode isIDLEand1when the sharing mode isDEDICATED. Amazon ECS counts the containers that it assigned to the GPU, not the processes that are running on it.Type: Integer
Required: No
- gpuId
-
The ID of the GPU. This ID matches the GPU IDs in the
gpuIdsof the containers that Amazon ECS assigned to the GPU.Type: String
Required: No
- remainingMemoryInMiB
-
The amount of GPU memory, in MiB, that's available to allocate to new containers that use the
nvidiaMpssharing strategy. Amazon ECS calculates this value from the memory that it allocated to containers on the GPU, not from the memory that the containers use.Type: Integer
Required: No
- sharingMode
-
How the GPU is shared between containers.
Valid values:
-
IDLE- No containers are assigned to the GPU, and all of its memory is available. -
NVIDIA_MPS- One or more containers share the GPU by using NVIDIA Multi-Process Service (MPS). -
DEDICATED- One container has exclusive use of the GPU.
Type: String
Valid Values:
IDLE | NVIDIA_MPS | DEDICATEDRequired: No
-
- totalMemoryInMiB
-
The total amount of GPU memory, in MiB, that the Amazon ECS container agent reported for the GPU. This is the memory that's available to containers, and it can be less than the nominal memory of the GPU.
Type: Integer
Required: No
See Also
For more information about using this API in one of the language-specific AWS SDKs, see the following: