Skip to content

EC2  >  Structures  >  InferenceDeviceMemoryInfo

InferenceDeviceMemoryInfo

Structure Class

InferenceDeviceMemoryInfo dataclass

Bases: _SerdeShape

Note

Amazon Elastic Inference is no longer available.

Describes the memory available to the inference accelerator.

Attributes

size_in_mi_b class-attribute instance-attribute
size_in_mi_b: int | None = ...

The size of the memory available to the inference accelerator, in MiB.