A Coalition Formation Game Approach for Personalized Federated Learning

02/05/2022
by   Leijie Wu, et al.
2

Facing the challenge of statistical diversity in client local data distribution, personalized federated learning (PFL) has become a growing research hotspot. Although the state-of-the-art methods with model similarity-based pairwise collaboration have achieved promising performance, they neglect the fact that model aggregation is essentially a collaboration process within the coalition, where the complex multiwise influences take place among clients. In this paper, we first apply Shapley value (SV) from coalition game theory into the PFL scenario. To measure the multiwise collaboration among a group of clients on the personalized learning performance, SV takes their marginal contribution to the final result as a metric. We propose a novel personalized algorithm: pFedSV, which can 1. identify each client's optimal collaborator coalition and 2. perform personalized model aggregation based on SV. Extensive experiments on various datasets (MNIST, Fashion-MNIST, and CIFAR-10) are conducted with different Non-IID data settings (Pathological and Dirichlet). The results show that pFedSV can achieve superior personalized accuracy for each client, compared to the state-of-the-art benchmarks.

READ FULL TEXT

Authors

page 1

page 2

page 3

page 4

11/04/2021

Parameterized Knowledge Transfer for Personalized Federated Learning

In recent years, personalized federated learning (pFL) has attracted inc...
07/07/2020

Personalized Federated Learning: An Attentive Collaboration Approach

For the challenging computational environment of IOT/edge computing, per...
05/09/2022

Layer-wised Model Aggregation for Personalized Federated Learning

Personalized Federated Learning (pFL) not only can capture the common pr...
03/02/2022

Personalized Federated Learning With Structure

Knowledge sharing and model personalization are two key components to im...
07/02/2021

On Bridging Generic and Personalized Federated Learning

Federated learning is promising for its ability to collaboratively train...
06/16/2022

Personalized Federated Learning via Variational Bayesian Inference

Federated learning faces huge challenges from model overfitting due to t...
09/16/2021

Subspace Learning for Personalized Federated Optimization

As data is generated and stored almost everywhere, learning a model from...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.