Overfitting
When a model memorizes its training data instead of learning the pattern behind it. The signature: training loss keeps falling while validation loss turns back up.
Companion explanation in Step by Token, chapter 6.
Where this term gets built
Continue