The three regimes of a training point

ProofAdvanced⏱ 30 minClassical MLsvmkktsupport vectorsclassification of points

Theory: Support Vector Machines — Complete Derivation →

Problem

From the soft-margin KKT conditions, derive the complete classification of training points by their multiplier: $\alpha_i = 0$ , $0<\alpha_i<C$ , $\alpha_i = C$ . Give the margin value and slack in each case.

Write a complete argument. Every inequality you use should be one you could state precisely.

Solution

Opening this before you have a real attempt on paper is the fastest way to feel like you understand something you cannot reproduce.

Related problems

All problems

Problem	Field	Type	Difficulty	Time
The geometric margin	Classical ML	Proof	Foundation	15 min
Solve a two-point SVM by hand	Classical ML	Numerical	Beginner	30 min
Complementary slackness and active constraints	Advanced Optimization	Proof	Intermediate	30 min
The soft-margin SVM is regularised hinge-loss minimisation	Classical ML	Proof	Intermediate	30 min
Derive the optimal weight update abyss	Quantization	Proof	Advanced	1 hour