Edge Federated Learning Via Unit-Modulus Over-The-Air Computation (Extended Version)

01/28/2021
by   Shuai Wang, et al.
0

Edge federated learning (FL) is an emerging machine learning paradigm that trains a global parametric model from distributed datasets via wireless communications. This paper proposes a unit-modulus over-the-air computation (UM-AirComp) framework to facilitate efficient edge federated learning, which simultaneously uploads local model parameters and updates global model parameters via analog beamforming. The proposed framework avoids sophisticated baseband signal processing, leading to low communication delays and implementation costs. A training loss bound of UM-AirComp is derived and two low-complexity algorithms, termed penalty alternating minimization (PAM) and accelerated gradient projection (AGP), are proposed to minimize the nonconvex nonsmooth loss bound. Simulation results show that the proposed UM-AirComp framework with PAM algorithm not only achieves a smaller mean square error of model parameters' estimation, training loss, and testing error, but also requires a significantly shorter runtime than that of other benchmark schemes. Moreover, the proposed UM-AirComp framework with AGP algorithm achieves satisfactory performance while reduces the computational complexity by orders of magnitude compared with existing optimization algorithms. Finally, we demonstrate the implementation of UM-AirComp in a vehicle-to-everything autonomous driving simulation platform. It is found that autonomous driving tasks are more sensitive to model parameter errors than other tasks since the former neural networks are more sophisticated containing sparser model parameters.

READ FULL TEXT
research
08/05/2021

User Scheduling for Federated Learning Through Over-the-Air Computation

A new machine learning (ML) technique termed as federated learning (FL) ...
research
06/28/2023

Communication Resources Constrained Hierarchical Federated Learning for End-to-End Autonomous Driving

While federated learning (FL) improves the generalization of end-to-end ...
research
10/07/2022

Time Minimization in Hierarchical Federated Learning

Federated Learning is a modern decentralized machine learning technique ...
research
02/28/2023

Joint Beamforming and Device Selection in Federated Learning with Over-the-air Aggregation

Federated Learning (FL) with over-the-air computation is susceptible to ...
research
05/20/2021

A Dispersed Federated Learning Framework for 6G-Enabled Autonomous Driving Cars

Sixth-Generation (6G)-based Internet of Everything applications (e.g. au...
research
03/22/2023

A Fast Path Loss Model for Wireless Channels Considering Environmental Factors

We present a path loss model that accurately predicts the path loss with...
research
03/03/2021

Temporal-Structure-Assisted Gradient Aggregation for Over-the-Air Federated Edge Learning

In this paper, we investigate over-the-air model aggregation in a federa...

Please sign up or login with your details

Forgot password? Click here to reset