Skip to content
nonconvexcard

The rank-one inverse update

ProofGraduate⏱ 1 hourQuantizationblock inverseschur complementlinear algebra

Problem

Prove that for H≻0H\succ0 with coordinate qq removed,

(H−q)−1=[H−1−1[H−1]qqH−1eqeq⊤H−1]−q,(H_{-q})^{-1} = \Big[H^{-1} - \tfrac{1}{[H^{-1}]_{qq}}H^{-1}e_qe_q^\top H^{-1}\Big]_{-q},

and explain why this makes a full sweep cost one inversion rather than dd.

Write a complete argument. Every inequality you use should be one you could state precisely.

Hints

Hints — 0 of 2 revealed

Solution

Opening this before you have a real attempt on paper is the fastest way to feel like you understand something you cannot reproduce.

Related problems

All problems
SolvedProblemFieldTypeDifficultyTime
Which weight to quantize nextQuantizationProofIntermediate30 min
Derive the optimal weight update abyssQuantizationProofAdvanced1 hour
Implement Hessian-aware rounding runQuantizationCodingAdvanced1 day
Schur complement and block positive semidefinitenessFoundationsProofAdvanced30 min