Deep Reinforcement Learning for Stochastic Computation Offloading in Digital Twin Networks

by   Yueyue Dai, et al.

The rapid development of Industrial Internet of Things (IIoT) requires industrial production towards digitalization to improve network efficiency. Digital Twin is a promising technology to empower the digital transformation of IIoT by creating virtual models of physical objects. However, the provision of network efficiency in IIoT is very challenging due to resource-constrained devices, stochastic tasks, and resources heterogeneity. Distributed resources in IIoT networks can be efficiently exploited through computation offloading to reduce energy consumption while enhancing data processing efficiency. In this paper, we first propose a new paradigm Digital Twin Networks (DTN) to build network topology and the stochastic task arrival model in IIoT systems. Then, we formulate the stochastic computation offloading and resource allocation problem to minimize the long-term energy efficiency. As the formulated problem is a stochastic programming problem, we leverage Lyapunov optimization technique to transform the original problem into a deterministic per-time slot problem. Finally, we present Asynchronous Actor-Critic (AAC) algorithm to find the optimal stochastic computation offloading policy. Illustrative results demonstrate that our proposed scheme is able to significantly outperforms the benchmarks.



There are no comments yet.


page 1


GJRA: A Global Joint Resource Allocation Scheme for UAV service of PEC in IIoTs

The Industrial Internet of Things (IIoT) is an emerging paradigm to make...

Edge Intelligence for Energy-efficient Computation Offloading and Resource Allocation in 5G Beyond

5G beyond is an end-edge-cloud orchestrated network that can exploit het...

Joint Device Association, Resource Allocation and Computation Offloading in Ultra-Dense Multi-Device and Multi-Task IoT Networks

With the emergence of more and more applications of Internet-of-Things (...

Computation Offloading at Field Level: Motivation and Break-Even Point Calculation

Smart manufacturing has the objective of creating highly flexible and re...

Asynchronous Mobile-Edge Computation Offloading: Energy-Efficient Resource Management

Mobile-edge computation offloading (MECO) is an emerging technology for ...

Privacy Aware Offloading of Deep Neural Networks

Deep neural networks require large amounts of resources which makes them...

Learn and Pick Right Nodes to Offload

Task offloading is a promising technology to exploit the benefits of fog...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.