Out-of-vocabulary
A token (or pair) that never appeared during training. Unsmoothed models can't assign it any probability.
Companion explanation in Step by Token, chapter 2.
Continue
A token (or pair) that never appeared during training. Unsmoothed models can't assign it any probability.
Companion explanation in Step by Token, chapter 2.
Continue