Probability distribution
A list of non-negative numbers that sum to 1, one per possible outcome. A language model's output is one such distribution over the vocabulary.
Companion explanation in Step by Token, chapter 7.
Where this term gets built
Continue