Joint Multi-User DNN Partitioning and Computational Resource Allocation for Collaborative Edge Intelligence

by   Xin Tang, et al.

Mobile Edge Computing (MEC) has emerged as a promising supporting architecture providing a variety of resources to the network edge, thus acting as an enabler for edge intelligence services empowering massive mobile and Internet of Things (IoT) devices with AI capability. With the assistance of edge servers, user equipments (UEs) are able to run deep neural network (DNN) based AI applications, which are generally resource-hungry and compute-intensive, such that an individual UE can hardly afford by itself in real time. However the resources in each individual edge server are typically limited. Therefore, any resource optimization involving edge servers is by nature a resource-constrained optimization problem and needs to be tackled in such realistic context. Motivated by this observation, we investigate the optimization problem of DNN partitioning (an emerging DNN offloading scheme) in a realistic multi-user resource-constrained condition that rarely considered in previous works. Despite the extremely large solution space, we reveal several properties of this specific optimization problem of joint multi-UE DNN partitioning and computational resource allocation. We propose an algorithm called Iterative Alternating Optimization (IAO) that can achieve the optimal solution in polynomial time. In addition, we present rigorous theoretic analysis of our algorithm in terms of time complexity and performance under realistic estimation error. Moreover, we build a prototype that implements our framework and conduct extensive experiments using realistic DNN models, whose results demonstrate its effectiveness and efficiency.


page 1

page 7


Deep Reinforcement Learning for Online Latency Aware Workload Offloading in Mobile Edge Computing

Owing to the resource-constrained feature of Internet of Things (IoT) de...

Resource Optimization for Blockchain-based Federated Learning in Mobile Edge Computing

With the development of mobile edge computing (MEC) and blockchain-based...

BEHAVE: Behavior-Aware, Intelligent and Fair Resource Management for Heterogeneous Edge-IoT Systems

Edge computing is an emerging solution to support the future Internet of...

Joint Program Partitioning and Resource Allocation for Completion Time Minimization in Multi-MEC Systems

This paper considers a practical mobile edge computing (MEC) system, whe...

HierTrain: Fast Hierarchical Edge AI Learning with Hybrid Parallelism in Mobile-Edge-Cloud Computing

Nowadays, deep neural networks (DNNs) are the core enablers for many eme...

Unified, User and Task (UUT) Centered Artificial Intelligence for Metaverse Edge Computing

The Metaverse can be considered the extension of the present-day web, wh...

Enabling AI Quality Control via Feature Hierarchical Edge Inference

With the rise of edge computing, various AI services are expected to be ...

Please sign up or login with your details

Forgot password? Click here to reset