research
∙
10/06/2022
Unmasking the Lottery Ticket Hypothesis: What's Encoded in a Winning Ticket's Mask?
Modern deep learning involves training costly, highly overparameterized ...
share
research
∙
06/02/2022
Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks
A striking observation about iterative magnitude pruning (IMP; Frankle e...
research
∙
01/25/2022
Sketching Matrix Least Squares via Leverage Scores Estimates
We consider the matrix least squares problem of the form 𝐀𝐗-𝐁_F^2 where ...
research
∙
07/13/2021
How many degrees of freedom do we need to train deep networks: a loss landscape perspective
A variety of recent works, spanning pruning, lottery tickets, and traini...
research
∙
06/30/2020