Skip to content

EC2  >  Structures  >  InferenceAcceleratorInfo

InferenceAcceleratorInfo

Structure Class

InferenceAcceleratorInfo dataclass

Bases: _SerdeShape

Note

Amazon Elastic Inference is no longer available.

Describes the Inference accelerators for the instance type.

Attributes

accelerators class-attribute instance-attribute 
accelerators: list[InferenceDeviceInfo] | None = ...

Describes the Inference accelerators for the instance type.

total_inference_memory_in_mi_b class-attribute instance-attribute 
total_inference_memory_in_mi_b: int | None = ...

The total size of the memory for the inference accelerators for the instance type, in MiB.