Lesson 3.3
Evaluating retrieval
Before blaming the model for a bad answer, check whether the right passage was ever retrieved. Recall at k tells you which half of the system to fix.
Taught byPriya RamanLLMs · RAG · Prompt engineering · Evaluation
Overview
Before blaming the model for a bad answer, check whether the right passage was ever retrieved. Recall at k tells you which half of the system to fix.
What this lesson covers
- Build a query set with known correct passages
- Measure recall and precision at k
- Separate retrieval failures from generation failures
This lesson sits in Retrieval Quality, part of Retrieval-Augmented Generation from Scratch. It assumes what came before it and leads directly into the next lesson in the module.
In this lesson you will:
- Build a query set with known correct passages
- Measure recall and precision at k
- Separate retrieval failures from generation failures