Over-the-Air Federated Edge Learning with Hierarchical Clustering

07/19/2022
by   Ozan Aygün, et al.
8

We examine federated learning (FL) with over-the-air (OTA) aggregation, where mobile users (MUs) aim to reach a consensus on a global model with the help of a parameter server (PS) that aggregates the local gradients. In OTA FL, MUs train their models using local data at every training round and transmit their gradients simultaneously using the same frequency band in an uncoded fashion. Based on the received signal of the superposed gradients, the PS performs a global model update. While the OTA FL has a significantly decreased communication cost, it is susceptible to adverse channel effects and noise. Employing multiple antennas at the receiver side can reduce these effects, yet the path-loss is still a limiting factor for users located far away from the PS. To ameliorate this issue, in this paper, we propose a wireless-based hierarchical FL scheme that uses intermediate servers (ISs) to form clusters at the areas where the MUs are more densely located. Our scheme utilizes OTA cluster aggregations for the communication of the MUs with their corresponding IS, and OTA global aggregations from the ISs to the PS. We present a convergence analysis for the proposed algorithm, and show through numerical evaluations of the derived analytical expressions and experimental results that utilizing ISs results in a faster convergence and a better performance than the OTA FL alone while using less transmit power. We also validate the results on the performance using different number of cluster iterations with different datasets and data distributions. We conclude that the best choice of cluster aggregations depends on the data distribution among the MUs and the clusters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/21/2021

Hierarchical Over-the-Air Federated Edge Learning

Federated learning (FL) over wireless communication channels, specifical...
research
11/07/2022

Over-The-Air Clustered Wireless Federated Learning

Privacy, security, and bandwidth constraints have led to federated learn...
research
08/05/2023

Private Federated Learning with Dynamic Power Control via Non-Coherent Over-the-Air Computation

To further preserve model weight privacy and improve model performance i...
research
05/19/2022

Dynamic Clustering and Power Control for Two-Tier Wireless Federated Learning

Federated learning (FL) has been recognized as a promising distributed l...
research
02/28/2023

Joint Beamforming and Device Selection in Federated Learning with Over-the-air Aggregation

Federated Learning (FL) with over-the-air computation is susceptible to ...
research
07/07/2022

Adaptive Personlization in Federated Learning for Highly Non-i.i.d. Data

Federated learning (FL) is a distributed learning method that offers med...
research
08/03/2020

Cluster-Based Cooperative Digital Over-the-Air Aggregation for Wireless Federated Edge Learning

In this paper, we study a federated learning system at the wireless edge...

Please sign up or login with your details

Forgot password? Click here to reset