JMSNAS: Joint Model Split and Neural Architecture Search for Learning over Mobile Edge Networks

11/16/2021
by   Yuqing Tian, et al.
0

The main challenge to deploy deep neural network (DNN) over a mobile edge network is how to split the DNN model so as to match the network architecture as well as all the nodes' computation and communication capacity. This essentially involves two highly coupled procedures: model generating and model splitting. In this paper, a joint model split and neural architecture search (JMSNAS) framework is proposed to automatically generate and deploy a DNN model over a mobile edge network. Considering both the computing and communication resource constraints, a computational graph search problem is formulated to find the multi-split points of the DNN model, and then the model is trained to meet some accuracy requirements. Moreover, the trade-off between model accuracy and completion latency is achieved through the proper design of the objective function. The experiment results confirm the superiority of the proposed framework over the state-of-the-art split machine learning design methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/30/2022

Neural Architecture Search for Improving Latency-Accuracy Trade-off in Split Computing

This paper proposes a neural architecture search (NAS) method for split ...
research
06/06/2020

Conditional Neural Architecture Search

Designing resource-efficient Deep Neural Networks (DNNs) is critical to ...
research
03/22/2023

Split-Et-Impera: A Framework for the Design of Distributed Deep Learning Applications

Many recent pattern recognition applications rely on complex distributed...
research
04/10/2022

SplitNets: Designing Neural Architectures for Efficient Distributed Computing on Head-Mounted Systems

We design deep neural networks (DNNs) and corresponding networks' splitt...
research
07/20/2021

LENS: Layer Distribution Enabled Neural Architecture Search in Edge-Cloud Hierarchies

Edge-Cloud hierarchical systems employing intelligence through Deep Neur...
research
08/30/2021

Communication-Computation Efficient Device-Edge Co-Inference via AutoML

Device-edge co-inference, which partitions a deep neural network between...
research
08/26/2021

StressNAS: Affect State and Stress Detection Using Neural Architecture Search

Smartwatches have rapidly evolved towards capabilities to accurately cap...

Please sign up or login with your details

Forgot password? Click here to reset