Separating convexity, strong convexity, smoothness and Lipschitzness
ProofIntermediate⏱ 30 minOptimizationcounterexamplespropertiesindependence
Problem
Consider four properties of a function :
- (C) is convex;
- (SC) is -strongly convex for some ;
- (S) is -smooth for some , i.e. differentiable with being -Lipschitz;
- (K) is -Lipschitz for some .
Only (SC) (C) holds by definition. Show that one further implication is forced and that the remaining combinations are all realisable:
- Prove that (SC) and (K) cannot hold simultaneously on all of .
- Give an satisfying (C) and (S) but neither (SC) nor (K), and prove it has these properties.
- Give an satisfying (C) and (K) but not (S).
- Give an satisfying (S) and (K) but not (C).
- Give an satisfying (SC) and (S), and compute its condition number.
Write a complete argument. Every inequality you use should be one you could state precisely.
Hints
Hints — 0 of 3 revealed
Solution
Opening this before you have a real attempt on paper is the fastest way to feel like you understand something you cannot reproduce.
Related problems
All problems| Solved | Problem | Field | Type | Difficulty | Time |
|---|---|---|---|---|---|
| Pairwise independence does not imply independence | Probability | Proof | 15 min | ||
| Every norm is convex, and the operator norm is a supremum of linear functions | Optimization | Proof | 15 min | ||
| Existence and uniqueness of the minimiser | Optimization | Proof | 15 min | ||
| First-order characterisation of convexity | Optimization | Proof | 30 min | ||
| Strong convexity implies the Polyak–Lojasiewicz inequality | Optimization | Proof | 30 min |