PerformanceConfiguration¶
Structure Class¶
dataclass
¶
Contains performance settings for a model.
Attributes¶
class-attribute
instance-attribute
¶
latency: PerformanceConfigLatency | None = None
Specifies whether to use the latency-optimized or standard version of a model or inference profile.