DAG-ACFL: Asynchronous Clustered Federated Learning based on DAG-DLT

08/25/2023
by   Xiaofeng Xue, et al.
0

Federated learning (FL) aims to collaboratively train a global model while ensuring client data privacy. However, FL faces challenges from the non-IID data distribution among clients. Clustered FL (CFL) has emerged as a promising solution, but most existing CFL frameworks adopt synchronous frameworks lacking asynchrony. An asynchronous CFL framework called SDAGFL based on directed acyclic graph distributed ledger techniques (DAG-DLT) was proposed, but its complete decentralization leads to high communication and storage costs. We propose DAG-ACFL, an asynchronous clustered FL framework based on directed acyclic graph distributed ledger techniques (DAG-DLT). We first detail the components of DAG-ACFL. A tip selection algorithm based on the cosine similarity of model parameters is then designed to aggregate models from clients with similar distributions. An adaptive tip selection algorithm leveraging change-point detection dynamically determines the number of selected tips. We evaluate the clustering and training performance of DAG-ACFL on multiple datasets and analyze its communication and storage costs. Experiments show the superiority of DAG-ACFL in asynchronous clustered FL. By combining DAG-DLT with clustered FL, DAG-ACFL realizes robust, decentralized and private model training with efficient performance.

READ FULL TEXT

page 1

page 6

page 8

research
04/16/2021

CSAFL: A Clustered Semi-Asynchronous Federated Learning Framework

Federated learning (FL) is an emerging distributed machine learning para...
research
11/08/2021

Papaya: Practical, Private, and Scalable Federated Learning

Cross-device Federated Learning (FL) is a distributed learning paradigm ...
research
08/22/2021

Flexible Clustered Federated Learning for Client-Level Data Distribution Shift

Federated Learning (FL) enables the multiple participating devices to co...
research
09/20/2023

Clustered FedStack: Intermediate Global Models with Bayesian Information Criterion

Federated Learning (FL) is currently one of the most popular technologie...
research
04/26/2023

Federated Learning with Uncertainty-Based Client Clustering for Fleet-Wide Fault Diagnosis

Operators from various industries have been pushing the adoption of wire...
research
05/12/2021

Clustered Sampling: Low-Variance and Improved Representativity for Clients Selection in Federated Learning

This work addresses the problem of optimizing communications between ser...
research
11/08/2022

Clustered Federated Learning based on Nonconvex Pairwise Fusion

This study investigates clustered federated learning (FL), one of the fo...

Please sign up or login with your details

Forgot password? Click here to reset