Evaluate knowledge base retrieval
Retrieving information for knowledge base evaluations involves pulling out highly relevant chunks of text from your sources of data. You can evaluate a knowledge base’s ability to retrieve information.
You use the metrics defined in the following table to evaluate how well the knowledge base retrieves information.
Evaluation type | Metrics | Metric definition |
---|---|---|
Retrieve information | Context relevance | Measures how contextually relevant the retrieved texts are to the questions. |
Context coverage (requires ground truth) | Measures how much the retrieved texts cover all the information in the ground truth texts. |
To learn more about each metric for knowledge base evaluations, see Review knowledge base evaluation job reports and metrics.