InferenceDeviceInfo¶
Structure Class¶
dataclass
¶
Bases: _SerdeShape
Note
Amazon Elastic Inference is no longer available.
Describes the Inference accelerators for the instance type.
Attributes¶
class-attribute
instance-attribute
¶
count: int | None = ...
The number of Inference accelerators for the instance type.
class-attribute
instance-attribute
¶
manufacturer: str | None = ...
The manufacturer of the Inference accelerator.
class-attribute
instance-attribute
¶
memory_info: InferenceDeviceMemoryInfo | None = ...
Describes the memory available to the inference accelerator.