Scaling law
Empirical observation that model quality improves predictably with parameters, training tokens, and compute. The Chinchilla rule: optimal tokens ≈ 20 × parameters.
Companion explanation in Step by Token, chapter 19.
Where this term gets built
Continue