FilFL: Accelerating Federated Learning via Client Filtering

02/13/2023
by   Fares Fourati, et al.
0

Federated learning is an emerging machine learning paradigm that enables devices to train collaboratively without exchanging their local data. The clients participating in the training process are a random subset selected from the pool of clients. The above procedure is called client selection which is an important area in federated learning as it highly impacts the convergence rate, learning efficiency, and generalization. In this work, we introduce client filtering in federated learning (FilFL), a new approach to optimize client selection and training. FilFL first filters the active clients by choosing a subset of them that maximizes a specific objective function; then, a client selection method is applied to that subset. We provide a thorough analysis of its convergence in a heterogeneous setting. Empirical results demonstrate several benefits to our approach, including improved learning efficiency, accelerated convergence, 2-3× faster, and higher test accuracy, around 2-10 percentage points higher.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/03/2020

Client Selection in Federated Learning: Convergence Analysis and Power-of-Choice Selection Strategies

Federated learning is a distributed optimization paradigm that enables a...
research
01/22/2020

Data Selection for Federated Learning with Relevant and Irrelevant Data at Clients

Federated learning is an effective way of training a machine learning mo...
research
06/04/2021

FedCCEA : A Practical Approach of Client Contribution Evaluation for Federated Learning

Client contribution evaluation, also known as data valuation, is a cruci...
research
08/16/2021

Client Selection Approach in Support of Clustered Federated Learning over Wireless Edge Networks

Clustered Federated Multitask Learning (CFL) was introduced as an effici...
research
12/06/2020

Accurate and Fast Federated Learning via Combinatorial Multi-Armed Bandits

Federated learning has emerged as an innovative paradigm of collaborativ...
research
06/20/2021

Is Shapley Value fair? Improving Client Selection for Mavericks in Federated Learning

Shapley Value is commonly adopted to measure and incentivize client part...
research
06/15/2022

Global Convergence of Federated Learning for Mixed Regression

This paper studies the problem of model training under Federated Learnin...

Please sign up or login with your details

Forgot password? Click here to reset