Skip to content
nonconvexcard

The floor that correlated failure puts under redundancy

ProofIntermediate⏱ 30 minAI Systemsavailabilitycorrelationbeta factorlimits

Problem

Model failures with a common-cause fraction β\beta: with probability β\beta an event takes down all nn replicas together, otherwise they fail independently, each with unavailability UU.

  1. Derive Un=(1−β)Un+βUU_n = (1-\beta)U^n + \beta U and show it is decreasing in nn with limit βU\beta U.
  2. With U=10−3U = 10^{-3}, tabulate UnU_n for n=1,2,3,∞n = 1,2,3,\infty at β=0\beta = 0 and β=0.01\beta = 0.01.
  3. Find the smallest nn at which adding a further replica improves UnU_n by less than 10% relative, when β=0.01\beta = 0.01 and U=10−3U = 10^{-3}.
  4. State what this implies about where availability effort should go.

Write a complete argument. Every inequality you use should be one you could state precisely.

Solution

Opening this before you have a real attempt on paper is the fastest way to feel like you understand something you cannot reproduce.

Related problems

All problems
SolvedProblemFieldTypeDifficultyTime
In-sample calibration of logistic regressionClassical MLProofIntermediate30 min
The 1/n variance rate requires uncorrelated samplesProbabilityNumericalIntermediate30 min
The bagging variance formulaClassical MLProofIntermediate30 min
What correlation does to votingAgentsProofIntermediate30 min
Simulate an agent pipeline end to end runAgentsCodingAdvanced1 day