research
∙
08/25/2019
Theoretical Issues in Deep Networks: Approximation, Optimization and Generalization
While deep learning is successful in a number of applications, it is not...
share
research
∙
03/12/2019
Theory III: Dynamics and Generalization in Deep Networks
We review recent observations on the dynamical systems induced by gradie...
research
∙
11/08/2018
Biologically-plausible learning algorithms can scale to large datasets
The backpropagation (BP) algorithm is often thought to be biologically i...
research
∙
07/25/2018
A Surprising Linear Relationship Predicts Test Performance in Deep Networks
Given two networks with the same training loss on a dataset, when would ...
research
∙
06/29/2018
Theory IIIb: Generalization in Deep Networks
A main puzzle of deep neural networks (DNNs) revolves around the apparen...
research
∙
01/07/2018
Theory of Deep Learning IIb: Optimization Properties of SGD
In Theory IIb we characterize with a mix of theory and experiments the o...
research
∙
12/30/2017
Theory of Deep Learning III: explaining the non-overfitting puzzle
A main puzzle of deep networks revolves around the absence of overfittin...
research
∙
03/28/2017
Theory II: Landscape of the Empirical Risk in Deep Learning
Previous theoretical work on deep learning and neural network optimizati...
research
∙
01/18/2017
Compression of Deep Neural Networks for Image Instance Retrieval
Image instance retrieval is the problem of retrieving images from a data...
research
∙
10/19/2016
Streaming Normalization: Towards Simpler and More Biologically-plausible Normalizations for Online and Recurrent Learning
We systematically explored a spectrum of normalization algorithms relate...
research
∙
06/05/2016
View-tolerant face recognition and Hebbian learning imply mirror-symmetric neural tuning to head orientation
The primate brain contains a hierarchy of visual areas, dubbed the ventr...
research
∙
04/13/2016
Bridging the Gaps Between Residual Learning, Recurrent Neural Networks and Visual Cortex
We discuss relations between Residual Networks (ResNet), Recurrent Neura...
research
∙
09/12/2014
Unsupervised learning of clutter-resistant visual representations from natural videos
Populations of neurons in inferotemporal cortex (IT) maintain an explici...
research
∙
11/16/2013