Skip to content
nonconvexcard

The reliability wall

NumericalBeginner⏱ 15 minAgentshorizonreliabilityplanning

Problem

Tabulate the per-step reliability needed for 99% trajectory success at horizons n=10,50,100,500n = 10, 50, 100, 500. Express each as an error rate, and comment on what this implies for long-horizon autonomy.

Compute the requested quantities and say what they mean. A number without an interpretation is not an answer.

Solution

Opening this before you have a real attempt on paper is the fastest way to feel like you understand something you cannot reproduce.

Related problems

All problems
SolvedProblemFieldTypeDifficultyTime
Trajectory success from per-step reliabilityAgentsNumericalFoundation15 min
Detect-and-retry arithmeticAgentsProofIntermediate30 min
Majority voting via HoeffdingAgentsProofIntermediate30 min
What correlation does to votingAgentsProofIntermediate30 min
Simulate an agent pipeline end to end runAgentsCodingAdvanced1 day