Fast Convergence Algorithm for Analog Federated Learning

10/30/2020
by   Shuhao Xia, et al.
0

In this paper, we consider federated learning (FL) over a noisy fading multiple access channel (MAC), where an edge server aggregates the local models transmitted by multiple end devices through over-the-air computation (AirComp). To realize efficient analog federated learning over wireless channels, we propose an AirComp-based FedSplit algorithm, where a threshold-based device selection scheme is adopted to achieve reliable local model uploading. In particular, we analyze the performance of the proposed algorithm and prove that the proposed algorithm linearly converges to the optimal solutions under the assumption that the objective function is strongly convex and smooth. We also characterize the robustness of proposed algorithm to the ill-conditioned problems, thereby achieving fast convergence rates and reducing communication rounds. A finite error bound is further provided to reveal the relationship between the convergence behavior and the channel fading and noise. Our algorithm is theoretically and experimentally verified to be much more robust to the ill-conditioned problems with faster convergence compared with other benchmark FL algorithms.

READ FULL TEXT
research
06/15/2021

Over-the-Air Decentralized Federated Learning

In this paper, we consider decentralized federated learning (FL) over wi...
research
04/15/2022

Server Free Wireless Federated Learning: Architecture, Algorithm, and Analysis

We demonstrate that merely analog transmissions and match filtering can ...
research
07/26/2021

Accelerated Gradient Descent Learning over Multiple Access Fading Channels

We consider a distributed learning problem in a wireless network, consis...
research
08/25/2023

Federated Linear Bandit Learning via Over-the-Air Computation

In this paper, we investigate federated contextual linear bandit learnin...
research
08/20/2019

On Analog Gradient Descent Learning over Multiple Access Fading Channels

We consider a distributed learning problem over multiple access channel ...
research
08/17/2023

Over-the-Air Computation Aided Federated Learning with the Aggregation of Normalized Gradient

Over-the-air computation is a communication-efficient solution for feder...
research
06/12/2022

Communication-Efficient Federated Learning over MIMO Multiple Access Channels

Communication efficiency is of importance for wireless federated learnin...

Please sign up or login with your details

Forgot password? Click here to reset