On the Convergence of Clustered Federated Learning

02/13/2022
by   Jie Ma, et al.
0

In a federated learning system, the clients, e.g. mobile devices and organization participants, usually have different personal preferences or behavior patterns, namely Non-IID data problems across clients. Clustered federated learning is to group users into different clusters that the clients in the same group will share the same or similar behavior patterns that are to satisfy the IID data assumption for most traditional machine learning algorithms. Most of the existing clustering methods in FL treat every client equally that ignores the different importance contributions among clients. This paper proposes a novel weighted client-based clustered FL algorithm to leverage the client's group and each client in a unified optimization framework. Moreover, the paper proposes convergence analysis to the proposed clustered FL method. The experimental analysis has demonstrated the effectiveness of the proposed method.

READ FULL TEXT
research
03/02/2023

Stochastic Clustered Federated Learning

Federated learning is a distributed learning framework that takes full a...
research
10/04/2019

Clustered Federated Learning: Model-Agnostic Distributed Multi-Task Optimization under Privacy Constraints

Federated Learning (FL) is currently the most widely adopted framework f...
research
06/15/2022

Clustered Scheduling and Communication Pipelining For Efficient Resource Management Of Wireless Federated Learning

This paper proposes using communication pipelining to enhance the wirele...
research
03/23/2022

Mining Latent Relationships among Clients: Peer-to-peer Federated Learning with Adaptive Neighbor Matching

In federated learning (FL), clients may have diverse objectives, merging...
research
04/26/2023

Federated Learning with Uncertainty-Based Client Clustering for Fleet-Wide Fault Diagnosis

Operators from various industries have been pushing the adoption of wire...
research
09/04/2023

Federated cINN Clustering for Accurate Clustered Federated Learning

Federated Learning (FL) presents an innovative approach to privacy-prese...
research
05/26/2022

A Unified Analysis of Federated Learning with Arbitrary Client Participation

Federated learning (FL) faces challenges of intermittent client availabi...

Please sign up or login with your details

Forgot password? Click here to reset