EvaluatorConfig¶

Union Type¶

EvaluatorConfig = Union[EvaluatorConfigLlmAsAJudge | EvaluatorConfigCodeBased | EvaluatorConfigUnknown]

The configuration that defines how an evaluator assesses agent performance, including the evaluation method and parameters.

The LLM-as-a-Judge configuration that uses a language model to evaluate agent performance based on custom instructions and rating scales.

value: LlmAsAJudgeEvaluatorConfig

Configuration for a code-based evaluator that uses a customer-managed Lambda function to programmatically assess agent performance.

value: CodeBasedEvaluatorConfig

Represents an unknown variant.

If you receive this value, you will need to update your library to receive the parsed value.

This value may not be deliberately sent.

tag: str