Unsourced Massive Access-Based Digital Over-the-Air Computation for Efficient Federated Edge Learning

05/17/2023
by   Li Qiao, et al.
0

Over-the-air computation (OAC) is a promising technique to achieve fast model aggregation across multiple devices in federated edge learning (FEEL). In addition to the analog schemes, one-bit digital aggregation (OBDA) scheme was proposed to adapt OAC to modern digital wireless systems. However, one-bit quantization in OBDA can result in a serious information loss and slower convergence of FEEL. To overcome this limitation, this paper proposes an unsourced massive access (UMA)-based generalized digital OAC (GD-OAC) scheme. Specifically, at the transmitter, all the devices share the same non-orthogonal UMA codebook for uplink transmission. The local model update of each device is quantized based on the same quantization codebook. Then, each device transmits a sequence selected from the UMA codebook based on the quantized elements of its model update. At the receiver, we propose an approximate message passing-based algorithm for efficient UMA detection and model aggregation. Simulation results show that the proposed GD-OAC scheme significantly accelerates the FEEL convergences compared with the state-of-the-art OBDA scheme while using the same uplink communication resources.

READ FULL TEXT

page 1

page 2

page 3

research
01/16/2020

One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning: Design and Convergence Analysis

Federated edge learning (FEEL) is a popular framework for model training...
research
03/03/2021

Temporal-Structure-Assisted Gradient Aggregation for Over-the-Air Federated Edge Learning

In this paper, we investigate over-the-air model aggregation in a federa...
research
02/17/2022

Time-Correlated Sparsification for Efficient Over-the-Air Model Aggregation in Wireless Federated Learning

Federated edge learning (FEEL) is a promising distributed machine learni...
research
12/13/2022

Broadband Digital Over-the-Air Computation for Wireless Federated Edge Learning

This paper presents the first orthogonal frequency-division multiplexing...
research
05/06/2023

Semi-Asynchronous Federated Edge Learning Mechanism via Over-the-air Computation

Over-the-air Computation (AirComp) has been demonstrated as an effective...
research
08/03/2020

Cluster-Based Cooperative Digital Over-the-Air Aggregation for Wireless Federated Edge Learning

In this paper, we study a federated learning system at the wireless edge...
research
12/30/2018

Low-Latency Broadband Analog Aggregation for Federated Edge Learning

The popularity of mobile devices results in the availability of enormous...

Please sign up or login with your details

Forgot password? Click here to reset