CreateEvaluatorRequest
Types
Properties
A unique, case-sensitive identifier to ensure that the API request completes no more than one time. If you don't specify this field, a value is randomly generated for you. If this token matches a previous request, the service ignores the request, but doesn't return an error. For more information, see Ensuring idempotency.
The description of the evaluator that explains its purpose and evaluation criteria.
The configuration for the evaluator, including LLM-as-a-Judge settings with instructions, rating scale, and model configuration.
The name of the evaluator. Must be unique within your account.
The evaluation level that determines the scope of evaluation. Valid values are TOOL_CALL for individual tool invocations, TRACE for single request-response interactions, or SESSION for entire conversation sessions.