Convolutional Neural Networks > Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

Batch normalization (BN): to normalize a layer's output by also summing over the entire batch, and then performing a linear rescaling and shifting of a certain trainable amount.