research
∙
07/10/2023
Dynamics of Temporal Difference Reinforcement Learning
Reinforcement learning has been successful across several applications i...
share
research
∙
04/06/2023
Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networks
We analyze the dynamics of finite width effects in wide but finite featu...
research
∙
12/23/2022
The Onset of Variance-Limited Behavior for Networks in the Lazy and Rich Regimes
For small training set sizes P, the generalization error of wide neural ...
research
∙
10/05/2022
The Influence of Learning Rule on Representation Dynamics in Wide Neural Networks
It is unclear how changing the learning rule of a deep neural network al...
research
∙
05/19/2022
Self-Consistent Dynamical Field Theory of Kernel Evolution in Wide Neural Networks
We analyze feature learning in infinite width neural networks trained wi...
research
∙
10/29/2021
Neural Networks as Kernel Learners: The Silent Alignment Effect
Neural networks in the lazy training regime converge to kernel machines....
research
∙
10/14/2021
Capacity of Group-invariant Linear Readouts from Equivariant Representations: How Many Objects can be Linearly Classified Under All Possible Views?
Equivariance has emerged as a desirable property of representations of o...
research
∙
06/04/2021
Learning Curves for SGD on Structured Features
The generalization performance of a machine learning algorithm such as a...
research
∙
06/04/2021
Out-of-Distribution Generalization in Kernel Regression
In real word applications, data generating process for training a machin...
research
∙
05/29/2021
Rapid Feature Evolution Accelerates Learning in Neural Networks
Neural network (NN) training and generalization in the infinite-width li...
research
∙
06/23/2020
Statistical Mechanics of Generalization in Kernel Regression
Generalization beyond a training dataset is a main goal of machine learn...
research
∙
02/07/2020
Spectrum Dependent Learning Curves in Kernel Regression and Wide Neural Networks
A fundamental question in modern machine learning is how deep neural net...
research
∙
10/07/2018