Backpropagation

Algorithm that computes the gradient of the loss with respect to every parameter by walking the chain rule backwards through the network's operations.