Privacy-Preserving Serverless Edge Learning with Decentralized Small Data

11/29/2021
by   Shih-Chun Lin, et al.
0

In the last decade, data-driven algorithms outperformed traditional optimization-based algorithms in many research areas, such as computer vision, natural language processing, etc. However, extensive data usages bring a new challenge or even threat to deep learning algorithms, i.e., privacy-preserving. Distributed training strategies have recently become a promising approach to ensure data privacy when training deep models. This paper extends conventional serverless platforms with serverless edge learning architectures and provides an efficient distributed training framework from the networking perspective. This framework dynamically orchestrates available resources among heterogeneous physical units to efficiently fulfill deep learning objectives. The design jointly considers learning task requests and underlying infrastructure heterogeneity, including last-mile transmissions, computation abilities of mobile devices, edge and cloud computing centers, and devices battery status. Furthermore, to significantly reduce distributed training overheads, small-scale data training is proposed by integrating with a general, simple data classifier. This low-load enhancement can seamlessly work with various distributed deep models to improve communications and computation efficiencies during the training phase. Finally, open challenges and future research directions encourage the research community to develop efficient distributed deep learning techniques.

READ FULL TEXT

page 4

page 6

research
08/25/2020

New Directions in Distributed Deep Learning: Bringing the Network at Forefront of IoT Design

In this paper, we first highlight three major challenges to large-scale ...
research
06/15/2021

Coded Privacy-Preserving Computation at Edge Networks

Multi-party computation (MPC) is promising for privacy-preserving machin...
research
10/04/2017

Privacy-Preserving Deep Inference for Rich User Data on The Cloud

Deep neural networks are increasingly being used in a variety of machine...
research
04/28/2020

Private Dataset Generation Using Privacy Preserving Collaborative Learning

With increasing usage of deep learning algorithms in many application, n...
research
05/17/2022

Towards Resilient Access Equality for 6G Serverless p-LEO Satellite Networks

Low earth orbit (LEO) mega-constellations, integrating government space ...
research
04/13/2020

Deep-Edge: An Efficient Framework for Deep Learning Model Update on Heterogeneous Edge

Deep Learning (DL) model-based AI services are increasingly offered in a...
research
03/27/2018

The Future of CISE Distributed Research Infrastructure

Shared research infrastructure that is globally distributed and widely a...

Please sign up or login with your details

Forgot password? Click here to reset