Skip to content
nonconvexcard

Recall composes multiplicatively

NumericalBeginner⏱ 15 minRAGrecallpipelineceilingsystem design

Problem

A RAG pipeline has chunking recall 0.950.95, ANN index recall 0.900.90, top-kk truncation recall 0.950.95, and a reranker with recall 0.980.98 within the candidate set.

  1. Compute the end-to-end recall.
  2. Compute the effect of improving the reranker to 1.01.0.
  3. Compute the effect of improving the index to 0.980.98.
  4. State the design principle.

Compute the requested quantities and say what they mean. A number without an interpretation is not an answer.

Solution

Opening this before you have a real attempt on paper is the fastest way to feel like you understand something you cannot reproduce.

Related problems

All problems
SolvedProblemFieldTypeDifficultyTime
End-to-end recall arithmetic for a RAG systemRAGNumericalBeginner15 min
Product quantisation budget arithmeticRAGNumericalBeginner30 min
The random-hyperplane collision probabilityRAGProofIntermediate30 min
Implement SimHash LSH and measure recall runRAGCodingAdvanced3 hours
Why space-partitioning trees fail in high dimensionRAGProofAdvanced30 min