Skip to content
nonconvexcard

Separating convexity, strong convexity, smoothness and Lipschitzness

ProofIntermediate⏱ 30 minOptimizationcounterexamplespropertiesindependence

Problem

Consider four properties of a function f:R→Rf:\R\to\R:

  • (C) ff is convex;
  • (SC) ff is μ\mu-strongly convex for some μ>0\mu>0;
  • (S) ff is LL-smooth for some LL, i.e. differentiable with f′f' being LL-Lipschitz;
  • (K) ff is KK-Lipschitz for some KK.

Only (SC) ⇒\Rightarrow (C) holds by definition. Show that one further implication is forced and that the remaining combinations are all realisable:

  1. Prove that (SC) and (K) cannot hold simultaneously on all of R\R.
  2. Give an ff satisfying (C) and (S) but neither (SC) nor (K), and prove it has these properties.
  3. Give an ff satisfying (C) and (K) but not (S).
  4. Give an ff satisfying (S) and (K) but not (C).
  5. Give an ff satisfying (SC) and (S), and compute its condition number.

Write a complete argument. Every inequality you use should be one you could state precisely.

Hints

Hints — 0 of 3 revealed

Solution

Opening this before you have a real attempt on paper is the fastest way to feel like you understand something you cannot reproduce.

Related problems

All problems
SolvedProblemFieldTypeDifficultyTime
Pairwise independence does not imply independenceProbabilityProofFoundation15 min
Every norm is convex, and the operator norm is a supremum of linear functionsOptimizationProofBeginner15 min
Existence and uniqueness of the minimiserOptimizationProofBeginner15 min
First-order characterisation of convexityOptimizationProofBeginner30 min
Strong convexity implies the Polyak–Lojasiewicz inequalityOptimizationProofIntermediate30 min