Evaluate knowledge base retrieval - Amazon Bedrock

Evaluate knowledge base retrieval

Retrieving information for knowledge base evaluations involves pulling out highly relevant chunks of text from your sources of data. You can evaluate a knowledge base’s ability to retrieve information.

You use the metrics defined in the following table to evaluate how well the knowledge base retrieves information.

Evaluation type Metrics Metric definition
Retrieve information Context relevance Measures how contextually relevant the retrieved texts are to the questions.
Context coverage (requires ground truth) Measures how much the retrieved texts cover all the information in the ground truth texts.

To learn more about each metric for knowledge base evaluations, see Review knowledge base evaluation job reports and metrics.