Personalizing Federated Learning with Over-the-Air Computations

02/24/2023
by   Zihan Chen, et al.
0

Federated edge learning is a promising technology to deploy intelligence at the edge of wireless networks in a privacy-preserving manner. Under such a setting, multiple clients collaboratively train a global generic model under the coordination of an edge server. But the training efficiency is often throttled by challenges arising from limited communication and data heterogeneity. This paper presents a distributed training paradigm that employs analog over-the-air computation to address the communication bottleneck. Additionally, we leverage a bi-level optimization framework to personalize the federated learning model so as to cope with the data heterogeneity issue. As a result, it enhances the generalization and robustness of each client's local model. We elaborate on the model training procedure and its advantages over conventional frameworks. We provide a convergence analysis that theoretically demonstrates the training efficiency. We also conduct extensive experiments to validate the efficacy of the proposed framework.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/26/2019

Model Pruning Enables Efficient Federated Learning on Edge Devices

Federated learning is a recent approach for distributed model training w...
research
12/18/2020

Fairness and Accuracy in Federated Learning

In the federated learning setting, multiple clients jointly train a mode...
research
05/30/2023

Split Federated Learning: Speed up Model Training in Resource-Limited Wireless Networks

In this paper, we propose a novel distributed learning scheme, named gro...
research
12/20/2021

Semi-Decentralized Federated Edge Learning with Data and Device Heterogeneity

Federated edge learning (FEEL) has attracted much attention as a privacy...
research
06/17/2023

Edge Intelligence Over the Air: Two Faces of Interference in Federated Learning

Federated edge learning is envisioned as the bedrock of enabling intelli...
research
04/21/2023

Joint Client Assignment and UAV Route Planning for Indirect-Communication Federated Learning

Federated Learning (FL) is a machine learning approach that enables the ...
research
04/16/2022

DRFLM: Distributionally Robust Federated Learning with Inter-client Noise via Local Mixup

Recently, federated learning has emerged as a promising approach for tra...

Please sign up or login with your details

Forgot password? Click here to reset