Skip to content
The loss curve

Overfitting

When a model memorizes its training data instead of learning the pattern behind it. The signature: training loss keeps falling while validation loss turns back up.

Companion explanation in Step by Token, chapter 6.

Where this term gets built