Bedrock  >  Unions  >  EvaluationInferenceConfig

EvaluationInferenceConfig

Union Type

EvaluationInferenceConfig module-attribute

EvaluationInferenceConfig = Union[EvaluationInferenceConfigModels | EvaluationInferenceConfigRagConfigs | EvaluationInferenceConfigUnknown]

The configuration details of the inference model for an evaluation job.

For automated model evaluation jobs, only a single model is supported.

For human-based model evaluation jobs, your annotator can compare the responses for up to two different models.

Union Member Types

EvaluationInferenceConfigModels dataclass

Specifies the inference models.

Attributes

value instance-attribute

value: list[EvaluationModelConfig]

EvaluationInferenceConfigRagConfigs dataclass

Contains the configuration details of the inference for a knowledge base evaluation job, including either the retrieval only configuration or the retrieval with response generation configuration.

Attributes

value instance-attribute

value: list[RAGConfig]

EvaluationInferenceConfigUnknown dataclass

Represents an unknown variant.

If you receive this value, you will need to update your library to receive the parsed value.

This value may not be deliberately sent.

Attributes

tag instance-attribute

tag: str