research
∙
05/25/2023
Sharpness-Aware Minimization Leads to Low-Rank Features
Sharpness-aware minimization (SAM) is a recently proposed method that mi...
share
research
∙
01/30/2023
On student-teacher deviations in distillation: does it pay to disobey?
Knowledge distillation has been widely-used to improve the performance o...
research
∙
03/18/2021
The Low-Rank Simplicity Bias in Deep Networks
Modern deep neural networks are highly over-parameterized compared to th...
research
∙
10/06/2020
A Unifying View on Implicit Bias in Training Linear Neural Networks
We study the implicit bias of gradient flow (i.e., gradient descent with...
research
∙
01/29/2019
