Skip to content
nonconvexcard

Strong convexity implies the Polyak–Lojasiewicz inequality

ProofIntermediate⏱ 30 minOptimizationpl inequalitystrong convexitylinear convergence

Problem

Prove that μ\mu-strong convexity implies

∥∇f(x)∥22≥2μ(f(x)−f⋆)for all x.\|\nabla f(x)\|_2^2 \ge 2\mu\big(f(x)-f^\star\big) \quad\text{for all }x .

Then give an example of a non-convex function satisfying the PL inequality, showing PL is strictly weaker than strong convexity.

Write a complete argument. Every inequality you use should be one you could state precisely.

Hints

Hints — 0 of 2 revealed

Solution

Opening this before you have a real attempt on paper is the fastest way to feel like you understand something you cannot reproduce.

Related problems

All problems
SolvedProblemFieldTypeDifficultyTime
Every norm is convex, and the operator norm is a supremum of linear functionsOptimizationProofBeginner15 min
Existence and uniqueness of the minimiserOptimizationProofBeginner15 min
First-order characterisation of convexityOptimizationProofBeginner30 min
Separating convexity, strong convexity, smoothness and LipschitznessOptimizationProofIntermediate30 min
NTK convergence is a PL inequality abyssDL TheoryProofGraduate1 hour