research
∙
08/17/2023
Distributed Extra-gradient with Optimal Complexity and Communication Guarantees
We consider monotone variational inequality (VI) problems in multi-GPU s...
share
research
∙
06/08/2023
Federated Learning under Covariate Shifts with Generalization Guarantees
This paper addresses intra-client and inter-client covariate shifts in f...
research
∙
07/16/2022
MixTailor: Mixed Gradient Aggregation for Robust Learning Against Tailored Attacks
Implementations of SGD on distributed and multi-GPU systems creates new ...
research
∙
11/02/2021
Subquadratic Overparameterization for Shallow Neural Networks
Overparameterization refers to the important phenomenon where the width ...
research
∙
04/28/2021
NUQSGD: Provably Communication-efficient Data-parallel SGD via Nonuniform Quantization
As the size and complexity of models and datasets grow, so does the need...
research
∙
02/26/2021
On the Generalization of Stochastic Gradient Descent with Momentum
While momentum-based methods, in conjunction with stochastic gradient de...
research
∙
10/23/2020
Adaptive Gradient Quantization for Data-Parallel SGD
Many communication-efficient variants of SGD use gradient quantization s...
research
∙
08/16/2019
NUQSGD: Improved Communication Efficiency for Data-parallel SGD via Nonuniform Quantization
As the size and complexity of models and datasets grow, so does the need...
research
∙
09/12/2018