Deep Reinforcement Learning for Stochastic Computation Offloading in Digital Twin Networks

11/17/2020
by   Yueyue Dai, et al.
0

The rapid development of Industrial Internet of Things (IIoT) requires industrial production towards digitalization to improve network efficiency. Digital Twin is a promising technology to empower the digital transformation of IIoT by creating virtual models of physical objects. However, the provision of network efficiency in IIoT is very challenging due to resource-constrained devices, stochastic tasks, and resources heterogeneity. Distributed resources in IIoT networks can be efficiently exploited through computation offloading to reduce energy consumption while enhancing data processing efficiency. In this paper, we first propose a new paradigm Digital Twin Networks (DTN) to build network topology and the stochastic task arrival model in IIoT systems. Then, we formulate the stochastic computation offloading and resource allocation problem to minimize the long-term energy efficiency. As the formulated problem is a stochastic programming problem, we leverage Lyapunov optimization technique to transform the original problem into a deterministic per-time slot problem. Finally, we present Asynchronous Actor-Critic (AAC) algorithm to find the optimal stochastic computation offloading policy. Illustrative results demonstrate that our proposed scheme is able to significantly outperforms the benchmarks.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

05/17/2020

GJRA: A Global Joint Resource Allocation Scheme for UAV service of PEC in IIoTs

The Industrial Internet of Things (IIoT) is an emerging paradigm to make...
11/17/2020

Edge Intelligence for Energy-efficient Computation Offloading and Resource Allocation in 5G Beyond

5G beyond is an end-edge-cloud orchestrated network that can exploit het...
12/11/2021

Joint Device Association, Resource Allocation and Computation Offloading in Ultra-Dense Multi-Device and Multi-Task IoT Networks

With the emergence of more and more applications of Internet-of-Things (...
06/08/2021

Computation Offloading at Field Level: Motivation and Break-Even Point Calculation

Smart manufacturing has the objective of creating highly flexible and re...
01/11/2018

Asynchronous Mobile-Edge Computation Offloading: Energy-Efficient Resource Management

Mobile-edge computation offloading (MECO) is an emerging technology for ...
05/30/2018

Privacy Aware Offloading of Deep Neural Networks

Deep neural networks require large amounts of resources which makes them...
04/20/2018

Learn and Pick Right Nodes to Offload

Task offloading is a promising technology to exploit the benefits of fog...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.