-
Spherical Motion Dynamics of Deep Neural Networks with Batch Normalization and Weight Decay
We comprehensively reveal the learning dynamics of deep neural networks ...
06/15/2020 ∙ by Ruosi Wan, et al. ∙
0
∙
share
read it
-
Angle-based Search Space Shrinking for Neural Architecture Search
In this work, we present a simple and general search space shrinking met...
04/28/2020 ∙ by Yiming Hu, et al. ∙
0
∙
share
read it
-
Towards Stabilizing Batch Statistics in Backward Propagation of Batch Normalization
Batch Normalization (BN) is one of the most widely used techniques in De...
01/19/2020 ∙ by Junjie Yan, et al. ∙
20
∙
share
read it
-
Towards Making Deep Transfer Learning Never Hurt
Transfer learning have been frequently used to improve deep neural netwo...
11/18/2019 ∙ by Ruosi Wan, et al. ∙
0
∙
share
read it
-
Neural Control Variates for Variance Reduction
In statistics and machine learning, approximation of an intractable inte...
06/01/2018 ∙ by Zhanxing Zhu, et al. ∙
0
∙
share
read it
