FedABC: Targeting Fair Competition in Personalized Federated Learning

02/15/2023
by   Dui Wang, et al.
0

Federated learning aims to collaboratively train models without accessing their client's local private data. The data may be Non-IID for different clients and thus resulting in poor performance. Recently, personalized federated learning (PFL) has achieved great success in handling Non-IID data by enforcing regularization in local optimization or improving the model aggregation scheme on the server. However, most of the PFL approaches do not take into account the unfair competition issue caused by the imbalanced data distribution and lack of positive samples for some classes in each client. To address this issue, we propose a novel and generic PFL framework termed Federated Averaging via Binary Classification, dubbed FedABC. In particular, we adopt the “one-vs-all” training strategy in each client to alleviate the unfair competition between classes by constructing a personalized binary classification problem for each class. This may aggravate the class imbalance challenge and thus a novel personalized binary classification loss that incorporates both the under-sampling and hard sample mining strategies is designed. Extensive experiments are conducted on two popular datasets under different settings, and the results demonstrate that our FedABC can significantly outperform the existing counterparts.

READ FULL TEXT
research
02/05/2022

A Coalition Formation Game Approach for Personalized Federated Learning

Facing the challenge of statistical diversity in client local data distr...
research
05/10/2023

FedDWA: Personalized Federated Learning with Online Weight Adjustment

Different from conventional federated learning, personalized federated l...
research
01/01/2023

Federated Learning with Client-Exclusive Classes

Existing federated classification algorithms typically assume the local ...
research
05/21/2020

Global Multiclass Classification from Heterogeneous Local Models

Multiclass classification problems are most often solved by either train...
research
03/15/2023

Visual Prompt Based Personalized Federated Learning

As a popular paradigm of distributed learning, personalized federated le...
research
09/16/2021

Subspace Learning for Personalized Federated Optimization

As data is generated and stored almost everywhere, learning a model from...
research
08/16/2023

Towards Personalized Federated Learning via Heterogeneous Model Reassembly

This paper focuses on addressing the practical yet challenging problem o...

Please sign up or login with your details

Forgot password? Click here to reset