Trends and Advancements in Deep Neural Network Communication

03/06/2020
by   Felix Sattler, et al.
0

Due to their great performance and scalability properties neural networks have become ubiquitous building blocks of many applications. With the rise of mobile and IoT, these models now are also being increasingly applied in distributed settings, where the owners of the data are separated by limited communication channels and privacy constraints. To address the challenges of these distributed environments, a wide range of training and evaluation schemes have been developed, which require the communication of neural network parametrizations. These novel approaches, which bring the "intelligence to the data" have many advantages over traditional cloud solutions such as privacy-preservation, increased security and device autonomy, communication efficiency and high training speed. This paper gives an overview over the recent advancements and challenges in this new field of research at the intersection of machine learning and communications.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/21/2019

Challenges of Privacy-Preserving Machine Learning in IoT

The Internet of Things (IoT) will be a main data generation infrastructu...
research
09/04/2019

Big Data Intelligence Using Distributed Deep Neural Networks

Large amount of data is often required to train and deploy useful machin...
research
03/06/2020

Communication Optimization Strategies for Distributed Deep Learning: A Survey

Recent trends in high-performance computing and deep learning lead to a ...
research
05/15/2020

New Frontiers in IoT: Networking, Systems, Reliability, and Security Challenges

The field of IoT has blossomed and is positively influencing many applic...
research
06/28/2023

Towards a Better Theoretical Understanding of Independent Subnetwork Training

Modern advancements in large-scale machine learning would be impossible ...
research
07/22/2020

Breaking the Communication-Privacy-Accuracy Trilemma

Two major challenges in distributed learning and estimation are 1) prese...
research
04/21/2020

Neural forecasting: Introduction and literature overview

Neural network based forecasting methods have become ubiquitous in large...

Please sign up or login with your details

Forgot password? Click here to reset