Skip to content
The loss curve

Subword

Token that is shorter than a word but longer than a character. The granularity BPE settles on.

Companion explanation in Step by Token, chapter 2.

Where this term gets built