Skip to content
nonconvexcard

Measure the covariance estimation rate

CodingIntermediate⏱ 1 hourHigh-Dim Statisticssimulationcovariancerateoperator norm

Problem

Empirically verify the rate ∥Σ^−Σ∥≍p/n+p/n\|\hat\Sigma-\Sigma\| \asymp \sqrt{p/n}+p/n for Gaussian data with Σ=Ip\Sigma = I_p.

  1. Fix pp and sweep nn; plot the error on log–log axes and fit the slope.
  2. Fix n/pn/p and sweep both; confirm the error depends only on the ratio.
  3. Compare the measured error with the theoretical (1+p/n)2−1(1+\sqrt{p/n})^2-1 from the Marchenko–Pastur upper edge.

Implement it, then check the implementation against something you can verify independently.

Write it

Solve it here7 tests · Python runs in your browser
⌘/Ctrl + ↵ to run · limit 60s · draft saved in this browser
7 tests will run against your code. The first run downloads the Python runtime — several megabytes, once per browser.

Solution

Opening this before you have a real attempt on paper is the fastest way to feel like you understand something you cannot reproduce.

Related problems

All problems
SolvedProblemFieldTypeDifficultyTime
Simulate distance contrast runClassical MLCodingBeginner30 min
Balls into bins, with one choice and with two runAI SystemsCodingIntermediate1 hour
Bounding the spectral norm by row and column sumsFoundationsProofIntermediate30 min
Cache hit rates under Zipf popularity runAI SystemsCodingIntermediate1 hour
Frobenius versus operator norm for random matricesRandom MatricesNumericalIntermediate30 min