1-Bit Compressive Sensing for Efficient Federated Learning Over the Air

03/30/2021
by   Xin Fan, et al.
0

For distributed learning among collaborative users, this paper develops and analyzes a communication-efficient scheme for federated learning (FL) over the air, which incorporates 1-bit compressive sensing (CS) into analog aggregation transmissions. To facilitate design parameter optimization, we theoretically analyze the efficacy of the proposed scheme by deriving a closed-form expression for the expected convergence rate of the FL over the air. Our theoretical results reveal the tradeoff between convergence performance and communication efficiency as a result of the aggregation errors caused by sparsification, dimension reduction, quantization, signal reconstruction and noise. Then, we formulate 1-bit CS based FL over the air as a joint optimization problem to mitigate the impact of these aggregation errors through joint optimal design of worker scheduling and power scaling policy. An enumeration-based method is proposed to solve this non-convex problem, which is optimal but becomes computationally infeasible as the number of devices increases. For scalable computing, we resort to the alternating direction method of multipliers (ADMM) technique to develop an efficient implementation that is suitable for large-scale networks. Simulation results show that our proposed 1-bit CS based FL over the air achieves comparable performance to the ideal case where conventional FL without compression and quantification is applied over error-free aggregation, at much reduced communication overhead and transmission latency.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/08/2021

Joint Optimization of Communications and Federated Learning Over the Air

Federated learning (FL) is an attractive paradigm for making use of rich...
research
03/20/2023

Over-the-Air Federated Edge Learning with Error-Feedback One-Bit Quantization and Power Control

Over-the-air federated edge learning (Air-FEEL) is a communication-effic...
research
02/28/2023

Joint Beamforming and Device Selection in Federated Learning with Over-the-air Aggregation

Federated Learning (FL) with over-the-air computation is susceptible to ...
research
05/19/2022

Dynamic Clustering and Power Control for Two-Tier Wireless Federated Learning

Federated learning (FL) has been recognized as a promising distributed l...
research
02/05/2021

Learning Rate Optimization for Federated Learning Exploiting Over-the-air Computation

Federated learning (FL) as a promising edge-learning framework can effec...
research
04/06/2023

Approximate Wireless Communication for Federated Learning

This paper presents an approximate wireless communication scheme for fed...
research
05/10/2023

Spectrum Breathing: Protecting Over-the-Air Federated Learning Against Interference

Federated Learning (FL) is a widely embraced paradigm for distilling art...

Please sign up or login with your details

Forgot password? Click here to reset