research
∙
04/28/2022
Personalized Federated Learning with Multiple Known Clusters
We consider the problem of personalized federated learning when there ar...
share
research
∙
02/19/2021
Personalized Federated Learning: A Unified Framework and Universal Optimization Techniques
We study the optimization aspects of personalized Federated Learning (FL...
research
∙
02/14/2021
Smoothness Matrices Beat Smoothness Constants: Better Communication Compression Techniques for Distributed Optimization
Large scale distributed optimization has become the default tool for the...
research
∙
11/03/2020
Local SGD: Unified Theory and New Efficient Methods
We present a unified framework for analyzing local SGD methods in the co...
research
∙
10/05/2020
Lower Bounds and Optimal Algorithms for Personalized Federated Learning
In this work, we consider the optimization formulation of personalized f...
research
∙
08/26/2020
Optimization for Supervised Machine Learning: Randomized Algorithms for Data and Parameters
Many key problems in machine learning and data science are routinely mod...
research
∙
02/21/2020
Stochastic Subspace Cubic Newton Method
In this paper, we propose a new randomized second-order optimization alg...
research
∙
02/11/2020
Variance Reduced Coordinate Descent with Acceleration: New Method With a Surprising Application to Finite-Sum Problems
We propose an accelerated version of stochastic variance reduced coordin...
research
∙
02/10/2020
Federated Learning of a Mixture of Global and Local Models
We propose a new optimization formulation for training federated learnin...
research
∙
05/27/2019
One Method to Rule Them All: Variance Reduction for Data, Parameters and Many New Methods
We propose a remarkably general variance-reduced method suitable for sol...
research
∙
05/27/2019
A Unified Theory of SGD: Variance Reduction, Sampling, Quantization and Coordinate Descent
In this paper we introduce a unified analysis of a large family of varia...
research
∙
05/25/2019
Best Pair Formulation & Accelerated Scheme for Non-convex Principal Component Pursuit
The best pair problem aims to find a pair of points that minimize the di...
research
∙
01/27/2019
99
It is well known that many optimization methods, including SGD, SAGA, an...
research
∙
01/27/2019
A Privacy Preserving Randomized Gossip Algorithm via Controlled Noise Insertion
In this work we present a randomized gossip algorithm for solving the av...
research
∙
09/09/2018
SEGA: Variance Reduction via Gradient Sketching
We propose a randomized first order optimization method--SEGA (SkEtched ...
research
∙
05/21/2018
A Nonconvex Projection Method for Robust PCA
Robust principal component analysis (RPCA) is a well-studied problem wit...
research
∙
03/20/2018
Fastest Rates for Stochastic Mirror Descent Methods
Relative smoothness - a notion introduced by Birnbaum et al. (2011) and ...
research
∙
02/12/2018