-
Collegial Ensembles
Modern neural network performance typically improves as model size incre...
06/13/2020 ∙ by Etai Littwin, et al. ∙
0
∙
share
read it
-
On the Optimization Dynamics of Wide Hypernetworks
Recent results in the theoretical study of deep learning have shown that...
03/27/2020 ∙ by Etai Littwin, et al. ∙
2
∙
share
read it
-
Residual Tangent Kernels
A recent body of work has focused on the theoretical study of neural net...
01/28/2020 ∙ by Etai Littwin, et al. ∙
0
∙
share
read it
-
On the Convex Behavior of Deep Neural Networks in Relation to the Layers' Width
The Hessian of neural networks can be decomposed into a sum of two matri...
01/14/2020 ∙ by Etai Littwin, et al. ∙
0
∙
share
read it
-
Regularizing by the Variance of the Activations' Sample-Variances
Normalization techniques play an important role in supporting efficient ...
11/21/2018 ∙ by Etai Littwin, et al. ∙
0
∙
share
read it
-
The Loss Surface of Residual Networks: Ensembles and the Role of Batch Normalization
Deep Residual Networks present a premium in performance in comparison to...
11/08/2016 ∙ by Etai Littwin, et al. ∙
0
∙
share
read it
-
The Multiverse Loss for Robust Transfer Learning
Deep learning techniques are renowned for supporting effective transfer ...
11/29/2015 ∙ by Etai Littwin, et al. ∙
0
∙
share
read it
