Recall composes multiplicatively
NumericalBeginner⏱ 15 minRAGrecallpipelineceilingsystem design
Problem
A RAG pipeline has chunking recall , ANN index recall , top- truncation recall , and a reranker with recall within the candidate set.
- Compute the end-to-end recall.
- Compute the effect of improving the reranker to .
- Compute the effect of improving the index to .
- State the design principle.
Compute the requested quantities and say what they mean. A number without an interpretation is not an answer.
Solution
Opening this before you have a real attempt on paper is the fastest way to feel like you understand something you cannot reproduce.
Related problems
All problems| Solved | Problem | Field | Type | Difficulty | Time |
|---|---|---|---|---|---|
| End-to-end recall arithmetic for a RAG system | RAG | Numerical | 15 min | ||
| Product quantisation budget arithmetic | RAG | Numerical | 30 min | ||
| The random-hyperplane collision probability | RAG | Proof | 30 min | ||
| Implement SimHash LSH and measure recall run | RAG | Coding | 3 hours | ||
| Why space-partitioning trees fail in high dimension | RAG | Proof | 30 min |