The round-trip error bound
ProofFoundation⏱ 15 minQuantizationroundingbound
Problem
Prove that an affine quantizer with step satisfies for every unclipped , and show the bound is attained. Then show that the bound fails, and by how much, when lies outside the clipping range.
Write a complete argument. Every inequality you use should be one you could state precisely.
Solution
Opening this before you have a real attempt on paper is the fastest way to feel like you understand something you cannot reproduce.
Related problems
All problems| Solved | Problem | Field | Type | Difficulty | Time |
|---|---|---|---|---|---|
| The true bit width of a group-quantized format | Quantization | Numerical | 15 min | ||
| Six decibels per bit, and what outliers cost | Quantization | Numerical | 30 min | ||
| The Δ²/12 noise variance | Quantization | Proof | 15 min | ||
| AdaBoost drives training error to zero exponentially | Classical ML | Proof | 1 hour | ||
| Optimal clipping for a Laplace-distributed tensor | Quantization | Proof | 1 hour |