research
∙
06/22/2022
A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta
Mini-batch SGD with momentum is a fundamental algorithm for learning lar...
share
research
∙
02/24/2022
Embedded Ensembles: Infinite Width Limit and Operating Regimes
A memory efficient approach to ensembling neural networks is to share mo...
research
∙
02/02/2022
Tight Convergence Rate Bounds for Optimization Under Power Law Spectral Conditions
Performance of optimization on quadratic problems sensitively depends on...
research
∙
05/02/2021