Enabling Large-Scale Federated Learning over Wireless Edge Networks

09/22/2021
by   Thinh Quang Dinh, et al.
0

Major bottlenecks of large-scale Federated Learning(FL) networks are the high costs for communication and computation. This is due to the fact that most of current FL frameworks only consider a star network topology where all local trained models are aggregated at a single server (e.g., a cloud server). This causes significant overhead at the server when the number of users are huge and local models' sizes are large. This paper proposes a novel edge network architecture which decentralizes the model aggregation process at the server, thereby significantly reducing the aggregation latency of the whole network. In this architecture, we propose a highly-effective in-network computation protocol consisting of two components. First, an in-network aggregation process is designed so that the majority of aggregation computations can be offloaded from cloud server to edge nodes. Second, a joint routing and resource allocation optimization problem is formulated to minimize the aggregation latency for the whole system at every learning round. The problem turns out to be NP-hard, and thus we propose a polynomial time routing algorithm which can achieve near optimal performance with a theoretical bound. Numerical results show that our proposed framework can dramatically reduce the network latency, up to 4.6 times. Furthermore, this framework can significantly decrease cloud's traffic and computing overhead by a factor of K/M, where K is the number of users and M is the number of edge nodes, in comparison with conventional baselines.

READ FULL TEXT
research
09/22/2021

In-network Computation for Large-scale Federated Learning over Wireless Edge Networks

Most conventional Federated Learning (FL) models are using a star networ...
research
05/25/2022

Scalable and Low-Latency Federated Learning with Cooperative Mobile Edge Networking

Federated learning (FL) enables collaborative model training without cen...
research
10/31/2019

Computation Resource Leasing for Priority Aggregation Local Computing Network

In large scale smart edge networks, computation resource is generally un...
research
02/26/2020

HFEL: Joint Edge Association and Resource Allocation for Cost-Efficient Hierarchical Federated Edge Learning

Federated Learning (FL) has been proposed as an appealing approach to ha...
research
03/19/2023

Hierarchical Personalized Federated Learning Over Massive Mobile Edge Computing Networks

Personalized Federated Learning (PFL) is a new Federated Learning (FL) p...
research
04/15/2022

Server Free Wireless Federated Learning: Architecture, Algorithm, and Analysis

We demonstrate that merely analog transmissions and match filtering can ...
research
10/18/2021

Semi-asynchronous Hierarchical Federated Learning for Cooperative Intelligent Transportation Systems

Cooperative Intelligent Transport System (C-ITS) is a promising network ...

Please sign up or login with your details

Forgot password? Click here to reset