Semi-Decentralized Federated Edge Learning with Data and Device Heterogeneity

12/20/2021
by   Yuchang Sun, et al.
3

Federated edge learning (FEEL) has attracted much attention as a privacy-preserving paradigm to effectively incorporate the distributed data at the network edge for training deep learning models. Nevertheless, the limited coverage of a single edge server results in an insufficient number of participated client nodes, which may impair the learning performance. In this paper, we investigate a novel framework of FEEL, namely semi-decentralized federated edge learning (SD-FEEL), where multiple edge servers are employed to collectively coordinate a large number of client nodes. By exploiting the low-latency communication among edge servers for efficient model sharing, SD-FEEL can incorporate more training data, while enjoying much lower latency compared with conventional federated learning. We detail the training algorithm for SD-FEEL with three main steps, including local model update, intra-cluster, and inter-cluster model aggregations. The convergence of this algorithm is proved on non-independent and identically distributed (non-IID) data, which also helps to reveal the effects of key parameters on the training efficiency and provides practical design guidelines. Meanwhile, the heterogeneity of edge devices may cause the straggler effect and deteriorate the convergence speed of SD-FEEL. To resolve this issue, we propose an asynchronous training algorithm with a staleness-aware aggregation scheme for SD-FEEL, of which, the convergence performance is also analyzed. The simulation results demonstrate the effectiveness and efficiency of the proposed algorithms for SD-FEEL and corroborate our analysis.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/09/2021

Asynchronous Semi-Decentralized Federated Edge Learning for Heterogeneous Clients

Federated edge learning (FEEL) has drawn much attention as a privacy-pre...
research
04/26/2021

Semi-Decentralized Federated Edge Learning for Fast Convergence on Non-IID Data

Federated edge learning (FEEL) has emerged as an effective alternative t...
research
02/24/2023

Personalizing Federated Learning with Over-the-Air Computations

Federated edge learning is a promising technology to deploy intelligence...
research
08/02/2023

Straggler Mitigation and Latency Optimization in Blockchain-based Hierarchical Federated Learning

Cloud-edge-device hierarchical federated learning (HFL) has been recentl...
research
07/30/2021

Decentralized Deep Learning for Mobile Edge Computing: A Survey on Communication Efficiency and Trustworthiness

A wider coverage and a better solution to latency reduction in 5G necess...
research
11/22/2020

A decentralized aggregation mechanism for training deep learning models using smart contract system for bank loan prediction

Data privacy and sharing has always been a critical issue when trying to...
research
04/26/2023

Fair Selection of Edge Nodes to Participate in Clustered Federated Multitask Learning

Clustered federated Multitask learning is introduced as an efficient tec...

Please sign up or login with your details

Forgot password? Click here to reset