Skip to content
nonconvexcard

Rademacher projections work too

ProofAdvanced⏱ 1 hourHigh-Dim Probabilityjlrademachersub-gaussiandatabase-friendly

Problem

Let A∈Rk×DA\in\R^{k\times D} have i.i.d. entries Arj=εrj/kA_{rj} = \eps_{rj}/\sqrt k with εrj\eps_{rj} Rademacher signs. Prove that for a fixed unit xx,

P(∣∥Ax∥22−1∣≥ε)≤2e−ckε2\P\big(\big|\|Ax\|_2^2-1\big|\ge\eps\big)\le2e^{-ck\eps^2}

for an absolute constant cc. Where does the proof differ from the Gaussian case, and what is gained in practice?

Write a complete argument. Every inequality you use should be one you could state precisely.

Hints

Hints — 0 of 3 revealed

Solution

Opening this before you have a real attempt on paper is the fastest way to feel like you understand something you cannot reproduce.

Related problems

All problems
SolvedProblemFieldTypeDifficultyTime
Johnson–Lindenstrauss dimension arithmeticHigh-Dim ProbabilityNumericalBeginner15 min
The psi-2 norm of a Rademacher signHigh-Dim ProbabilityNumericalBeginner15 min
From distance preservation to inner-product preservationHigh-Dim ProbabilityProofIntermediate30 min
Implement random projection and measure the distortion runHigh-Dim ProbabilityCodingIntermediate1 hour
Moments from tail bounds via the layer-cake formulaProbabilityProofIntermediate30 min