Bandit-based Communication-Efficient Client Selection Strategies for Federated Learning

12/14/2020
by   Yae Jee Cho, et al.
0

Due to communication constraints and intermittent client availability in federated learning, only a subset of clients can participate in each training round. While most prior works assume uniform and unbiased client selection, recent work on biased client selection has shown that selecting clients with higher local losses can improve error convergence speed. However, previously proposed biased selection strategies either require additional communication cost for evaluating the exact local loss or utilize stale local loss, which can even make the model diverge. In this paper, we present a bandit-based communication-efficient client selection strategy UCB-CS that achieves faster convergence with lower communication overhead. We also demonstrate how client selection can be used to improve fairness.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/03/2020

Client Selection in Federated Learning: Convergence Analysis and Power-of-Choice Selection Strategies

Federated learning is a distributed optimization paradigm that enables a...
research
05/13/2022

Federated Learning Under Intermittent Client Availability and Time-Varying Communication Constraints

Federated learning systems facilitate training of global models in setti...
research
06/20/2021

Is Shapley Value fair? Improving Client Selection for Mavericks in Federated Learning

Shapley Value is commonly adopted to measure and incentivize client part...
research
04/28/2023

Client Recruitment for Federated Learning in ICU Length of Stay Prediction

Machine and deep learning methods for medical and healthcare application...
research
05/18/2023

Client Selection for Federated Policy Optimization with Environment Heterogeneity

The development of Policy Iteration (PI) has inspired many recent algori...
research
06/27/2023

Understanding Client Reactions in Online Mental Health Counseling

Communication success relies heavily on reading participants' reactions....
research
05/08/2021

Loss Tolerant Federated Learning

Federated learning has attracted attention in recent years for collabora...

Please sign up or login with your details

Forgot password? Click here to reset