Communication Efficiency in Federated Learning: Achievements and Challenges

07/23/2021
by   Osama Shahid, et al.
14

Federated Learning (FL) is known to perform Machine Learning tasks in a distributed manner. Over the years, this has become an emerging technology especially with various data protection and privacy policies being imposed FL allows performing machine learning tasks whilst adhering to these challenges. As with the emerging of any new technology, there are going to be challenges and benefits. A challenge that exists in FL is the communication costs, as FL takes place in a distributed environment where devices connected over the network have to constantly share their updates this can create a communication bottleneck. In this paper, we present a survey of the research that is performed to overcome the communication constraints in an FL setting.

READ FULL TEXT

page 3

page 8

research
03/26/2023

A Generalized Look at Federated Learning: Survey and Perspectives

Federated learning (FL) refers to a distributed machine learning framewo...
research
08/12/2021

Communication Optimization in Large Scale Federated Learning using Autoencoder Compressed Weight Updates

Federated Learning (FL) solves many of this decade's concerns regarding ...
research
02/15/2023

Experimenting with Emerging ARM and RISC-V Systems for Decentralised Machine Learning

Decentralised Machine Learning (DML) enables collaborative machine learn...
research
10/20/2020

Federated Bayesian Optimization via Thompson Sampling

Bayesian optimization (BO) is a prominent approach to optimizing expensi...
research
05/03/2022

Local Stochastic Bilevel Optimization with Momentum-Based Variance Reduction

Bilevel Optimization has witnessed notable progress recently with new em...
research
06/21/2022

An Energy and Carbon Footprint Analysis of Distributed and Federated Learning

Classical and centralized Artificial Intelligence (AI) methods require m...
research
10/14/2021

Federated learning and next generation wireless communications: A survey on bidirectional relationship

In order to meet the extremely heterogeneous requirements of the next ge...

Please sign up or login with your details

Forgot password? Click here to reset