Gradient descent

Optimization procedure: subtract a small multiple of the gradient from the parameters at each step.

Companion explanation in Step by Token, chapter 6.