Warmup

Ramping the learning rate up from near zero over the first few hundred steps. Early gradients are large and badly scaled; warmup stops them from wrecking the initial weights.