Subspace Learning for Personalized Federated Optimization

09/16/2021
by   Seok-Ju Hahn, et al.
0

As data is generated and stored almost everywhere, learning a model from a data-decentralized setting is a task of interest for many AI-driven service providers. Although federated learning is settled down as the main solution in such situations, there still exists room for improvement in terms of personalization. Training federated learning systems usually focuses on optimizing a global model that is identically deployed to all client devices. However, a single global model is not sufficient for each client to be personalized on their performance as local data assumes to be not identically distributed across clients. We propose a method to address this situation through the lens of ensemble learning based on the construction of a low-loss subspace continuum that generates a high-accuracy ensemble of two endpoints (i.e. global model and local model). We demonstrate that our method achieves consistent gains both in personalized and unseen client evaluation settings through extensive experiments on several standard benchmark datasets.

READ FULL TEXT
research
12/02/2022

FedALA: Adaptive Local Aggregation for Personalized Federated Learning

A key challenge in federated learning (FL) is the statistical heterogene...
research
12/07/2022

Partial Disentanglement with Partially-Federated GANs (PaDPaF)

Federated learning has become a popular machine learning paradigm with m...
research
05/13/2022

Federated Learning Under Intermittent Client Availability and Time-Varying Communication Constraints

Federated learning systems facilitate training of global models in setti...
research
10/13/2021

WAFFLE: Weighted Averaging for Personalized Federated Learning

In collaborative or federated learning, model personalization can be a v...
research
11/05/2021

Data Selection for Efficient Model Update in Federated Learning

The Federated Learning workflow of training a centralized model with dis...
research
02/15/2023

FedABC: Targeting Fair Competition in Personalized Federated Learning

Federated learning aims to collaboratively train models without accessin...
research
03/23/2023

Federated Uncertainty-Aware Aggregation for Fundus Diabetic Retinopathy Staging

Deep learning models have shown promising performance in the field of di...

Please sign up or login with your details

Forgot password? Click here to reset