Evaluating the Communication Efficiency in Federated Learning Algorithms

04/06/2020
by   Ahmed Moustafa, et al.
0

In the era of advanced technologies, mobile devices are equipped with computing and sensing capabilities that gather excessive amounts of data. These amounts of data are suitable for training different learning models. Cooperated with advancements in Deep Learning (DL), these learning models empower numerous useful applications, e.g., image processing, speech recognition, healthcare, vehicular network and many more. Traditionally, Machine Learning (ML) approaches require data to be centralised in cloud-based data-centres. However, this data is often large in quantity and privacy-sensitive which prevents logging into these data-centres for training the learning models. In turn, this results in critical issues of high latency and communication inefficiency. Recently, in light of new privacy legislations in many countries, the concept of Federated Learning (FL) has been introduced. In FL, mobile users are empowered to learn a global model by aggregating their local models, without sharing the privacy-sensitive data. Usually, these mobile users have slow network connections to the data-centre where the global model is maintained. Moreover, in a complex and large scale network, heterogeneous devices that have various energy constraints are involved. This raises the challenge of communication cost when implementing FL at large scale. To this end, in this research, we begin with the fundamentals of FL, and then, we highlight the recent FL algorithms and evaluate their communication efficiency with detailed comparisons. Furthermore, we propose a set of solutions to alleviate the existing FL problems both from communication perspective and privacy perspective.

READ FULL TEXT
research
09/26/2019

Federated Learning in Mobile Edge Networks: A Comprehensive Survey

In recent years, mobile devices are equipped with increasingly advanced ...
research
10/30/2022

Evaluation and comparison of federated learning algorithms for Human Activity Recognition on smartphones

Pervasive computing promotes the integration of smart devices in our liv...
research
06/11/2021

Efficient and Less Centralized Federated Learning

With the rapid growth in mobile computing, massive amounts of data and c...
research
11/23/2022

A Dynamic Weighted Federated Learning for Android Malware Classification

Android malware attacks are increasing daily at a tremendous volume, mak...
research
03/10/2023

Zone-based Federated Learning for Mobile Sensing Data

Mobile apps, such as mHealth and wellness applications, can benefit from...
research
12/05/2021

Joint Superposition Coding and Training for Federated Learning over Multi-Width Neural Networks

This paper aims to integrate two synergetic technologies, federated lear...
research
07/15/2022

Communication-Efficient Diffusion Strategy for Performance Improvement of Federated Learning with Non-IID Data

Federated learning (FL) is a novel learning paradigm that addresses the ...

Please sign up or login with your details

Forgot password? Click here to reset