research
∙
11/29/2022
Disentangling the Mechanisms Behind Implicit Regularization in SGD
A number of competing hypotheses have been proposed to explain why small...
share
research
∙
06/21/2022
On the Maximum Hessian Eigenvalue and Generalization
The mechanisms by which certain training interventions, such as increasi...
research
∙
02/26/2021
Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability
We empirically demonstrate that full-batch gradient descent on neural ne...
research
∙
10/18/2019