Loss mask
A per-token 0/1 vector saying which positions contribute to the loss. In SFT, prompt tokens get 0 and answer tokens get 1.
Continue
A per-token 0/1 vector saying which positions contribute to the loss. In SFT, prompt tokens get 0 and answer tokens get 1.
Continue