From Distributed Machine Learning to Federated Learning: A Survey

04/29/2021
by   Ji Liu, et al.
0

In recent years, data and computing resources are typically distributed in the devices of end users, various regions or organizations. Because of laws or regulations, the distributed data and computing resources cannot be directly shared among different regions or organizations for machine learning tasks. Federated learning emerges as an efficient approach to exploit distributed data and computing resources, so as to collaboratively train machine learning models, while obeying the laws and regulations and ensuring data security and data privacy. In this paper, we provide a comprehensive survey of existing works for federated learning. We propose a functional architecture of federated learning systems and a taxonomy of related techniques. Furthermore, we present the distributed training, data communication, and security of FL systems. Finally, we analyze their limitations and propose future research directions.

READ FULL TEXT

page 1

page 2

page 3

page 4

06/12/2021

Federated Learning on Non-IID Data: A Survey

Federated learning is an emerging distributed machine learning framework...
08/31/2020

Federated Edge Learning : Design Issues and Challenges

Federated Learning (FL) is a distributed machine learning technique, whe...
06/29/2021

Bottleneck Time Minimization for Distributed Iterative Processes: Speeding Up Gossip-Based Federated Learning on Networked Computers

We present a novel task scheduling scheme for accelerating computational...
11/25/2018

A Survey of Mobile Computing for the Visually Impaired

The number of visually impaired or blind (VIB) people in the world is es...
04/19/2021

Federated Word2Vec: Leveraging Federated Learning to Encourage Collaborative Representation Learning

Large scale contextual representation models have significantly advanced...
01/25/2021

Adaptive Scheduling for Machine Learning Tasks over Networks

A key functionality of emerging connected autonomous systems such as sma...
03/22/2021

Federated Quantum Machine Learning

Distributed training across several quantum computers could significantl...