Level 12 of 27 · AI Workbench
Evaluate the retriever
Level 12 of 27 in the AI Workbench: a free AI exercise at Intermediate level, which takes about 30 minutes. Compare keyword, meaning-vector and hybrid retrieval on a staff handbook: recall at k, refusing the questions it cannot answer, and one failure of each method.
Goal
Compare keyword, meaning-vector and hybrid retrieval on a staff handbook: recall at k, refusing the questions it cannot answer, and one failure of each method.
Done when
The acceptance test marks the skills this level practises.
- Retrieval
- Recall at k
- Refusal limits
- Failure analysis
Skills
- Retrieval
- Recall at k
- Refusal limits
- Failure analysis
Before you start
Level 11, Build an evaluation set, comes first. Do it first if the ideas are new to you.
Free, in your browser, nothing to install. Your work is saved on this device. Updated 15 Nov 2026.