-
Collegial Ensembles
Modern neural network performance typically improves as model size incre...
read it
-
On the Optimization Dynamics of Wide Hypernetworks
Recent results in the theoretical study of deep learning have shown that...
read it
-
Residual Tangent Kernels
A recent body of work has focused on the theoretical study of neural net...
read it
-
On the Convex Behavior of Deep Neural Networks in Relation to the Layers' Width
The Hessian of neural networks can be decomposed into a sum of two matri...
read it
-
Regularizing by the Variance of the Activations' Sample-Variances
Normalization techniques play an important role in supporting efficient ...
read it
-
The Loss Surface of Residual Networks: Ensembles and the Role of Batch Normalization
Deep Residual Networks present a premium in performance in comparison to...
read it
-
The Multiverse Loss for Robust Transfer Learning
Deep learning techniques are renowned for supporting effective transfer ...
read it

Etai Littwin
is this you? claim profile