Bedrock  >  Structures  >  AutomatedEvaluationCustomMetricConfig

AutomatedEvaluationCustomMetricConfig

Structure Class

AutomatedEvaluationCustomMetricConfig dataclass

Defines the configuration of custom metrics to be used in an evaluation job. To learn more about using custom metrics in Amazon Bedrock evaluation jobs, see Create a prompt for a custom metrics (LLM-as-a-judge model evaluations) and Create a prompt for a custom metrics (RAG evaluations).

Attributes

custom_metrics instance-attribute

custom_metrics: list[AutomatedEvaluationCustomMetricSource]

Defines a list of custom metrics to be used in an Amazon Bedrock evaluation job.

evaluator_model_config instance-attribute

evaluator_model_config: CustomMetricEvaluatorModelConfig

Configuration of the evaluator model you want to use to evaluate custom metrics in an Amazon Bedrock evaluation job.