ModelConfiguration¶
Structure Class¶
ModelConfiguration
dataclass
¶
Contains the configuration for a model used in an advanced prompt optimization job, including the model ID and inference parameters.
Attributes¶
additional_model_request_fields
class-attribute
instance-attribute
¶
additional_model_request_fields: dict[str, Document] | None = None
Additional model request fields. Use this to pass model-specific parameters that are not included in the standard inference configuration.
inference_config
class-attribute
instance-attribute
¶
inference_config: InferenceConfiguration | None = None
The inference configuration for the model, including parameters such as maximum tokens, temperature, and top-p.