Skip to content
nonconvexcard

The net argument for the spectral norm

ProofGraduate⏱ 3 hoursRandom Matricesoperator normnetsub-gaussianunion boundflagship

Problem

Let A∈Rn×pA\in\R^{n\times p} have independent, mean-zero entries with ∥Aij∥ψ2≤K\|A_{ij}\|_{\psi_2}\le K. Prove that there is an absolute constant CC with

P(∥A∥≥CK(n+p+t))≤2e−t2\P\Big(\|A\| \ge CK\big(\sqrt n+\sqrt p+t\big)\Big) \le 2e^{-t^2}

for all t≥0t\ge0. Your proof must construct the nets, bound their sizes, control a single bilinear form, and perform the exponent count explicitly.

Write a complete argument. Every inequality you use should be one you could state precisely.

Hints

Hints — 0 of 3 revealed

Solution

Opening this before you have a real attempt on paper is the fastest way to feel like you understand something you cannot reproduce.

Related problems

All problems
SolvedProblemFieldTypeDifficultyTime
When is the union bound tight?ProbabilityProofFoundation15 min
Generalisation for a finite classLearning TheoryProofBeginner30 min
Bounding the spectral norm by row and column sumsFoundationsProofIntermediate30 min
Frobenius versus operator norm for random matricesRandom MatricesNumericalIntermediate30 min
Measure the covariance estimation rate runHigh-Dim StatisticsCodingIntermediate1 hour