research
∙
09/08/2022
Training Scale-Invariant Neural Networks on the Sphere Can Happen in Three Regimes
A fundamental property of deep learning normalization techniques, such a...
share
research
∙
06/29/2021
On the Periodic Behavior of Neural Network Training with Batch Normalization and Weight Decay
Despite the conventional wisdom that using batch normalization with weig...
research
∙
07/16/2020
On Power Laws in Deep Ensembles
Ensembles of deep neural networks are known to achieve state-of-the-art ...
research
∙
06/18/2020