Skip to content
nonconvexcard

Locating the Bernstein crossover

NumericalIntermediate⏱ 30 minHigh-Dim Probabilitybernsteinhoeffdingcrossovercomparison

Problem

Let X1,…,XnX_1,\dots,X_n be i.i.d. Bernoulli(p)(p) with p=0.01p = 0.01, centred, so ∣Xi∣≤1|X_i|\le1 and σ2=np(1−p)\sigma^2 = np(1-p).

  1. At which deviation tt do the two terms 2σ22\sigma^2 and 23Mt\tfrac23 Mt in Bernstein's denominator become equal?
  2. For n=104n = 10^4 and t=20t = 20, compare the Hoeffding and Bernstein bounds numerically.
  3. Explain in one sentence when each inequality is the right tool.

Compute the requested quantities and say what they mean. A number without an interpretation is not an answer.

Hints

Hints — 0 of 1 revealed

Solution

Opening this before you have a real attempt on paper is the fastest way to feel like you understand something you cannot reproduce.

Related problems

All problems
SolvedProblemFieldTypeDifficultyTime
Markov and Chebyshev are attainedHigh-Dim ProbabilityProofFoundation15 min
Derive the attention crossover lengthLLM OpsProofBeginner15 min
Generalisation for a finite classLearning TheoryProofBeginner30 min
Two different curses of dimensionalityClassical MLNumericalBeginner15 min
Azuma for a random walk with driftHigh-Dim ProbabilityProofIntermediate30 min