research
∙
05/30/2022
On Avoiding Local Minima Using Gradient Descent With Large Learning Rates
It has been widely observed in training of neural networks that when app...
share
research
∙
02/18/2022
ProxSkip: Yes! Local Gradient Steps Provably Lead to Communication Acceleration! Finally!
We introduce ProxSkip – a surprisingly simple and provably efficient met...
research
∙
02/03/2022
Characterizing Finding Good Data Orderings for Fast Convergence of Sequential Gradient Methods
While SGD, which samples from the data with replacement is widely studie...
research
∙
02/12/2018
Accelerated Stochastic Matrix Inversion: General Theory and Speeding up BFGS Rules for Faster Second-Order Optimization
We present the first accelerated randomized algorithm for solving linear...
research
∙
12/01/2013