Coded Matrix Computations for D2D-enabled Linearized Federated Learning

02/23/2023
by   Anindya Bijoy Das, et al.
0

Federated learning (FL) is a popular technique for training a global model on data distributed across client devices. Like other distributed training techniques, FL is susceptible to straggler (slower or failed) clients. Recent work has proposed to address this through device-to-device (D2D) offloading, which introduces privacy concerns. In this paper, we propose a novel straggler-optimal approach for coded matrix computations which can significantly reduce the communication delay and privacy issues introduced from D2D data transmissions in FL. Moreover, our proposed approach leads to a considerable improvement of the local computation speed when the generated data matrix is sparse. Numerical evaluations confirm the superiority of our proposed method over baseline approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/09/2023

Federated Coded Matrix Inversion

Federated learning (FL) is a decentralized model for training data distr...
research
06/04/2022

Hybrid Architectures for Distributed Machine Learning in Heterogeneous Wireless Networks

The ever-growing data privacy concerns have transformed machine learning...
research
11/26/2021

Dynamic Network-Assisted D2D-Aided Coded Distributed Learning

Today, various machine learning (ML) applications offer continuous data ...
research
03/15/2023

Towards Cooperative Federated Learning over Heterogeneous Edge/Fog Networks

Federated learning (FL) has been promoted as a popular technique for tra...
research
08/04/2022

Embedding Alignment for Unsupervised Federated Learning via Smart Data Exchange

Federated learning (FL) has been recognized as one of the most promising...
research
10/11/2021

Gradual Federated Learning with Simulated Annealing

Federated averaging (FedAvg) is a popular federated learning (FL) techni...
research
09/30/2021

Coding for Straggler Mitigation in Federated Learning

We present a novel coded federated learning (FL) scheme for linear regre...

Please sign up or login with your details

Forgot password? Click here to reset