Fit a scalability curve and find where it turns over
NumericalAdvanced⏱ 1 hourAI Systemsuniversal scalability lawcontentioncoherencycapacity
Problem
A distributed index reports relative capacity at shards:
| 1 | 2 | 4 | 8 | 16 | 32 | |
|---|---|---|---|---|---|---|
| 1.00 | 1.96 | 3.72 | 6.63 | 10.08 | 11.39 |
- Fit by least squares on , which is linear in the two parameters with no intercept.
- Predict and the capacity there.
- The team plans to run 64 shards. What does the model predict, and what would you tell them?
Compute the requested quantities and say what they mean. A number without an interpretation is not an answer.
Hints
Hints — 0 of 2 revealed
Solution
Opening this before you have a real attempt on paper is the fastest way to feel like you understand something you cannot reproduce.
Related problems
All problems| Solved | Problem | Field | Type | Difficulty | Time |
|---|---|---|---|---|---|
| Apply Little's law to a serving target | LLM Ops | Proof | 30 min | ||
| How many users fit on one GPU | LLM Ops | Numerical | 30 min | ||
| What fitting random labels rules out | DL Theory | Proof | 30 min |