Over-The-Air Federated Learning under Byzantine Attacks

05/05/2022
by   Houssem Sifaou, et al.
0

Federated learning (FL) is a promising solution to enable many AI applications, where sensitive datasets from distributed clients are needed for collaboratively training a global model. FL allows the clients to participate in the training phase, governed by a central server, without sharing their local data. One of the main challenges of FL is the communication overhead, where the model updates of the participating clients are sent to the central server at each global training round. Over-the-air computation (AirComp) has been recently proposed to alleviate the communication bottleneck where the model updates are sent simultaneously over the multiple-access channel. However, simple averaging of the model updates via AirComp makes the learning process vulnerable to random or intended modifications of the local model updates of some Byzantine clients. In this paper, we propose a transmission and aggregation framework to reduce the effect of such attacks while preserving the benefits of AirComp for FL. For the proposed robust approach, the central server divides the participating clients randomly into groups and allocates a transmission time slot for each group. The updates of the different groups are then aggregated using a robust aggregation technique. We extend our approach to handle the case of non-i.i.d. local data, where a resampling step is added before robust aggregation. We analyze the convergence of the proposed approach for both cases of i.i.d. and non-i.i.d. data and demonstrate that the proposed algorithm converges at a linear rate to a neighborhood of the optimal solution. Experiments on real datasets are provided to confirm the robustness of the proposed approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/01/2021

Robust Federated Learning via Over-The-Air Computation

This paper investigates the robustness of over-the-air federated learnin...
research
10/02/2020

F2ED-Learning: Good Fences Make Good Neighbors

In this paper, we present F2ED-Learning, the first federated learning pr...
research
06/15/2023

Opportunistic Transmission of Distributed Learning Models in Mobile UAVs

In this paper, we propose an opportunistic scheme for the transmission o...
research
01/14/2020

Adaptive Gradient Sparsification for Efficient Federated Learning: An Online Learning Approach

Federated learning (FL) is an emerging technique for training machine le...
research
09/28/2022

FedVeca: Federated Vectorized Averaging on Non-IID Data with Adaptive Bi-directional Global Objective

Federated Learning (FL) is a distributed machine learning framework to a...
research
10/29/2021

ADDS: Adaptive Differentiable Sampling for Robust Multi-Party Learning

Distributed multi-party learning provides an effective approach for trai...
research
09/24/2021

Paving the Way for Distributed ArtificialIntelligence over the Air

Distributed Artificial Intelligence (DAI) is regarded as one of the most...

Please sign up or login with your details

Forgot password? Click here to reset