Coded Computing for Federated Learning at the Edge

07/07/2020
by   Saurav Prakash, et al.
0

Federated Learning (FL) is an exciting new paradigm that enables training a global model from data generated locally at the client nodes, without moving client data to a centralized server. Performance of FL in a multi-access edge computing (MEC) network suffers from slow convergence due to heterogeneity and stochastic fluctuations in compute power and communication link qualities across clients. A recent work, Coded Federated Learning (CFL), proposes to mitigate stragglers and speed up training for linear regression tasks by assigning redundant computations at the MEC server. Coding redundancy in CFL is computed by exploiting statistical properties of compute and communication delays. We develop CodedFedL that addresses the difficult task of extending CFL to distributed non-linear regression and classification problems with multioutput labels. The key innovation of our work is to exploit distributed kernel embedding using random Fourier features that transforms the training task into distributed linear regression. We provide an analytical solution for load allocation, and demonstrate significant performance gains for CodedFedL through experiments over benchmark datasets using practical network parameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/12/2020

Coded Computing for Low-Latency Federated Learning over Wireless Edge Networks

Federated learning enables training a global model from data located at ...
research
06/22/2022

Federated Latent Class Regression for Hierarchical Data

Federated Learning (FL) allows a number of agents to participate in trai...
research
01/09/2023

Federated Coded Matrix Inversion

Federated learning (FL) is a decentralized model for training data distr...
research
02/21/2020

Coded Federated Learning

Federated learning is a method of training a global model from decentral...
research
05/02/2023

FedAVO: Improving Communication Efficiency in Federated Learning with African Vultures Optimizer

Federated Learning (FL), a distributed machine learning technique has re...
research
04/30/2020

Generalization Error for Linear Regression under Distributed Learning

Distributed learning facilitates the scaling-up of data processing by di...
research
06/22/2020

Exact Support Recovery in Federated Regression with One-shot Communication

Federated learning provides a framework to address the challenges of dis...

Please sign up or login with your details

Forgot password? Click here to reset