research
∙
11/30/2021
AutoDrop: Training Deep Learning Models with Automatic Learning Rate Drop
Modern deep learning (DL) architectures are trained using variants of th...
share
research
∙
11/25/2020
Continual learning with direction-constrained optimization
This paper studies a new design of the optimization algorithm for traini...
research
∙
05/24/2019
Leader Stochastic Gradient Descent for Distributed Training of Deep Learning Models
We consider distributed optimization under communication constraints for...
research
∙
02/10/2018