Distributed Learning in Wireless Networks: Recent Progress and Future Challenges

04/05/2021
by   Mingzhe Chen, et al.
41

The next-generation of wireless networks will enable many machine learning (ML) tools and applications to efficiently analyze various types of data collected by edge devices for inference, autonomy, and decision making purposes. However, due to resource constraints, delay limitations, and privacy challenges, edge devices cannot offload their entire collected datasets to a cloud server for centrally training their ML models or inference purposes. To overcome these challenges, distributed learning and inference techniques have been proposed as a means to enable edge devices to collaboratively train ML models without raw data exchanges, thus reducing the communication overhead and latency as well as improving data privacy. However, deploying distributed learning over wireless networks faces several challenges including the uncertain wireless environment, limited wireless resources (e.g., transmit power and radio spectrum), and hardware resources. This paper provides a comprehensive study of how distributed learning can be efficiently and effectively deployed over wireless edge networks. We present a detailed overview of several emerging distributed learning paradigms, including federated learning, federated distillation, distributed inference, and multi-agent reinforcement learning. For each learning framework, we first introduce the motivation for deploying it over wireless networks. Then, we present a detailed literature review on the use of communication techniques for its efficient deployment. We then introduce an illustrative example to show how to optimize wireless networks to improve its performance. Finally, we introduce future research opportunities. In a nutshell, this paper provides a holistic set of guidelines on how to deploy a broad range of distributed learning frameworks over real-world wireless communication networks.

READ FULL TEXT

Authors

page 1

11/14/2021

Edge-Native Intelligence for 6G Communications Driven by Federated Learning: A Survey of Trends and Challenges

The unprecedented surge of data volume in wireless networks empowered wi...
08/06/2020

Communication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applications

Machine learning (ML) is a promising enabler for the fifth generation (5...
12/02/2020

Distributed Machine Learning for Wireless Communication Networks: Techniques, Architectures, and Applications

Distributed machine learning (DML) techniques, such as federated learnin...
11/17/2020

Low-latency Federated Learning and Blockchain for Edge Association in Digital Twin empowered 6G Networks

Emerging technologies such as digital twins and 6th Generation mobile ne...
07/22/2018

Engineering Radio Map for Wireless Resource Management

Radio map in general refers to the geographical signal power spectrum de...
07/07/2021

In-Network Learning: Distributed Training and Inference in Networks

It is widely perceived that leveraging the success of modern machine lea...
08/16/2019

Distilling On-Device Intelligence at the Network Edge

Devices at the edge of wireless networks are the last mile data sources ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.