Offloading and Resource Allocation with General Task Graph in Mobile Edge Computing: A Deep Reinforcement Learning Approach

02/19/2020
by   Jia Yan, et al.
0

In this paper, we consider a mobile-edge computing system, where an access point assists a mobile device (MD) to execute an application consisting of multiple tasks following a general task call graph. The objective is to jointly determine the offloading decision of each task and the resource allocation under time-varying wireless fading channels and stochastic edge computing capability, so that the energy-time cost (ETC) of the MD is minimized. Solving the problem is particularly hard due to the combinatorial offloading decisions and the strong coupling among task executions under the general dependency model. Conventional numerical optimization methods are inefficient to solve such a problem, especially when the problem size is large. To address the issue, we propose a deep reinforcement learning (DRL) framework based on the actor-critic learning structure. In particular, the actor network utilizes a DNN to learn the optimal mapping from the input states to the binary offloading decision of each task. Meanwhile, by analyzing the structure of the optimal solution, we derive a low-complexity algorithm for the critic network to quickly evaluate the ETC performance of the offloading decisions output by the actor network. With the low-complexity critic network, we can quickly select the best offloading action and subsequently store the state-action pair in an experience replay memory as the training dataset to continuously improve the action generation DNN. To further reduce the complexity, we show that the optimal offloading decision exhibits an one-climb structure, which can be utilized to significantly reduce the search space of action generation. Numerical results show that for various types of task graphs, the proposed algorithm achieves up to 99.1% of the optimal performance while significantly reducing the computational complexity compared to the existing optimization methods.

READ FULL TEXT

page 1

page 4

page 6

page 9

page 13

page 16

page 18

page 31

research
10/26/2018

Optimal Offloading and Resource Allocation in Mobile-Edge Computing with Inter-user Task Dependency

Mobile-edge computing (MEC) has recently emerged as a cost-effective par...
research
08/06/2018

Deep Reinforcement Learning for Online Offloading in Wireless Powered Mobile-Edge Computing Networks

In this paper, we consider a wireless powered mobile-edge computing (MEC...
research
10/01/2021

Cellular traffic offloading via Opportunistic Networking with Reinforcement Learning

The widespread diffusion of mobile phones is triggering an exponential g...
research
01/26/2023

Learning to Generate All Feasible Actions

Several machine learning (ML) applications are characterized by searchin...
research
02/05/2021

Stable Online Computation Offloading via Lyapunov-guided Deep Reinforcement Learning

In this paper, we consider a multi-user mobile-edge computing (MEC) netw...
research
07/17/2023

A Fast Task Offloading Optimization Framework for IRS-Assisted Multi-Access Edge Computing System

Terahertz communication networks and intelligent reflecting surfaces exh...
research
06/29/2021

Structure-aware reinforcement learning for node-overload protection in mobile edge computing

Mobile Edge Computing (MEC) refers to the concept of placing computation...

Please sign up or login with your details

Forgot password? Click here to reset