Decorrelated Batch Normalization

Preprint English OPEN
Huang, Lei; Yang, Dawei; Lang, Bo; Deng, Jia;
  • Subject: Computer Science - Computer Vision and Pattern Recognition | Statistics - Machine Learning | Computer Science - Learning

Batch Normalization (BN) is capable of accelerating the training of deep models by centering and scaling activations within mini-batches. In this work, we propose Decorrelated Batch Normalization (DBN), which not just centers and scales activations but whitens them. We ... View more
Share - Bookmark