Skip to content
The loss curve

Query / Key / Value

Three projections of the input used in attention. Queries ask, keys advertise, values contribute.