Bedrock  >  Structures  >  EvaluationSummary

EvaluationSummary

Structure Class

EvaluationSummary dataclass

Summary information of an evaluation job.

Attributes

application_type class-attribute instance-attribute

application_type: ApplicationType | None = None

Specifies whether the evaluation job is for evaluating a model or evaluating a knowledge base (retrieval and response generation).

creation_time instance-attribute

creation_time: datetime

The time the evaluation job was created.

custom_metrics_evaluator_model_identifiers class-attribute instance-attribute

custom_metrics_evaluator_model_identifiers: list[str] | None = None

The Amazon Resource Names (ARNs) of the models used to compute custom metrics in an Amazon Bedrock evaluation job.

evaluation_task_types instance-attribute

evaluation_task_types: list[EvaluationTaskType]

The type of task for model evaluation.

evaluator_model_identifiers class-attribute instance-attribute

evaluator_model_identifiers: list[str] | None = None

The Amazon Resource Names (ARNs) of the models used to compute the metrics for a knowledge base evaluation job.

inference_config_summary class-attribute instance-attribute

inference_config_summary: EvaluationInferenceConfigSummary | None = None

Identifies the models, Knowledge Bases, or other RAG sources evaluated in a model or Knowledge Base evaluation job.

job_arn instance-attribute

job_arn: str

The Amazon Resource Name (ARN) of the evaluation job.

job_name instance-attribute

job_name: str

The name for the evaluation job.

job_type instance-attribute

job_type: EvaluationJobType

Specifies whether the evaluation job is automated or human-based.

model_identifiers class-attribute instance-attribute

model_identifiers: list[str] = field(default_factory=list[str])

The Amazon Resource Names (ARNs) of the model(s) used for the evaluation job.

rag_identifiers class-attribute instance-attribute

rag_identifiers: list[str] | None = None

The Amazon Resource Names (ARNs) of the knowledge base resources used for a knowledge base evaluation job.

status instance-attribute

status: EvaluationJobStatus

The current status of the evaluation job.