-
Spherical Motion Dynamics of Deep Neural Networks with Batch Normalization and Weight Decay
We comprehensively reveal the learning dynamics of deep neural networks ...
read it
-
Angle-based Search Space Shrinking for Neural Architecture Search
In this work, we present a simple and general search space shrinking met...
read it
-
Towards Stabilizing Batch Statistics in Backward Propagation of Batch Normalization
Batch Normalization (BN) is one of the most widely used techniques in De...
read it
-
Towards Making Deep Transfer Learning Never Hurt
Transfer learning have been frequently used to improve deep neural netwo...
read it
-
Neural Control Variates for Variance Reduction
In statistics and machine learning, approximation of an intractable inte...
read it

Ruosi Wan
is this you? claim profile