Client Selection in Federated Learning based on Gradients Importance

11/19/2021
by   Ouiame Marnissi, et al.
0

Federated learning (FL) enables multiple devices to collaboratively learn a global model without sharing their personal data. In real-world applications, the different parties are likely to have heterogeneous data distribution and limited communication bandwidth. In this paper, we are interested in improving the communication efficiency of FL systems. We investigate and design a device selection strategy based on the importance of the gradient norms. In particular, our approach consists of selecting devices with the highest norms of gradient values at each communication round. We study the convergence and the performance of such a selection technique and compare it to existing ones. We perform several experiments with non-iid set-up. The results show the convergence of our method with a considerable increase of test accuracy comparing to the random selection.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/09/2022

A Multi-agent Reinforcement Learning Approach for Efficient Client Selection in Federated Learning

Federated learning (FL) is a training technique that enables client devi...
research
03/30/2023

DPP-based Client Selection for Federated Learning with Non-IID Data

This paper proposes a client selection (CS) method to tackle the communi...
research
03/24/2021

FedGP: Correlation-Based Active Client Selection for Heterogeneous Federated Learning

Client-wise heterogeneity is one of the major issues that hinder effecti...
research
05/01/2021

FedProto: Federated Prototype Learning over Heterogeneous Devices

The heterogeneity across devices usually hinders the optimization conver...
research
06/19/2020

FedFMC: Sequential Efficient Federated Learning on Non-iid Data

As a mechanism for devices to update a global model without sharing data...
research
02/14/2023

EPISODE: Episodic Gradient Clipping with Periodic Resampled Corrections for Federated Learning with Heterogeneous Data

Gradient clipping is an important technique for deep neural networks wit...
research
02/08/2022

Learnings from Federated Learning in the Real world

Federated Learning (FL) applied to real world data may suffer from sever...

Please sign up or login with your details

Forgot password? Click here to reset