PerformanceConfiguration¶
Structure Class¶
PerformanceConfiguration
dataclass
¶
Performance settings for a model.
Attributes¶
latency
class-attribute
instance-attribute
¶
latency: PerformanceConfigLatency = PerformanceConfigLatency('standard')
To use a latency-optimized version of the model, set to optimized.