
-
FjORD: Fair and Accurate Federated Learning under heterogeneous targets with Ordered Dropout
Federated Learning (FL) has been gaining significant traction across dif...
read it
-
Hyperparameter Transfer Learning with Adaptive Complexity
Bayesian optimization (BO) is a sample efficient approach to automatical...
read it
-
Optimal Client Sampling for Federated Learning
It is well understood that client-master communication can be a primary ...
read it
-
Lower Bounds and Optimal Algorithms for Personalized Federated Learning
In this work, we consider the optimization formulation of personalized f...
read it
-
A Better Alternative to Error Feedback for Communication-Efficient Distributed Learning
Modern large-scale machine learning applications require stochastic opti...
read it
-
On Biased Compression for Distributed Learning
In the last few years, various communication compression techniques have...
read it
-
Adaptivity of Stochastic Gradient Methods for Nonconvex Optimization
Adaptivity is an important yet under-studied property in modern optimiza...
read it
-
Natural Compression for Distributed Deep Learning
Due to their hunger for big data, modern deep learning models are traine...
read it
-
Don't Jump Through Hoops and Remove Those Loops: SVRG and Katyusha are Better Without the Outer Loop
The stochastic variance-reduced gradient method (SVRG) and its accelerat...
read it