Layer normalization
Normalizes each token's activation vector to mean 0, std 1. Stabilizes activation scales across layers.
Companion explanation in Step by Token, chapter 5.
Where this term gets built
Continue
Normalizes each token's activation vector to mean 0, std 1. Stabilizes activation scales across layers.
Companion explanation in Step by Token, chapter 5.
Continue