Deep Reinforcement Learning for Collaborative Edge Computing in Vehicular Networks

10/05/2020
by   Mushu Li, et al.
0

Mobile edge computing (MEC) is a promising technology to support mission-critical vehicular applications, such as intelligent path planning and safety applications. In this paper, a collaborative edge computing framework is developed to reduce the computing service latency and improve service reliability for vehicular networks. First, a task partition and scheduling algorithm (TPSA) is proposed to decide the workload allocation and schedule the execution order of the tasks offloaded to the edge servers given a computation offloading strategy. Second, an artificial intelligence (AI) based collaborative computing approach is developed to determine the task offloading, computing, and result delivery policy for vehicles. Specifically, the offloading and computing problem is formulated as a Markov decision process. A deep reinforcement learning technique, i.e., deep deterministic policy gradient, is adopted to find the optimal solution in a complex urban transportation network. By our approach, the service cost, which includes computing service latency and service failure penalty, can be minimized via the optimal workload assignment and server selection in collaborative computing. Simulation results show that the proposed AI-based collaborative computing approach can adapt to a highly dynamic environment with outstanding performance.

READ FULL TEXT

page 8

page 9

page 10

page 13

page 14

page 22

page 25

page 30

research
12/27/2018

Vehicular Edge Computing via Deep Reinforcement Learning

The smart vehicles construct Vehicle of Internet which can execute vario...
research
12/17/2021

D3PG: Dirichlet DDGP for Task Partitioning and Offloading with Constrained Hybrid Action Space in Mobile Edge Computing

Mobile Edge Computing (MEC) has been regarded as a promising paradigm to...
research
11/13/2022

Social Welfare Maximization for Collaborative Edge Computing: A Deep Reinforcement Learning-Based Approach

Collaborative Edge Computing (CEC) is an effective method that improves ...
research
04/14/2023

Spectrum-aware Multi-hop Task Routing in Vehicle-assisted Collaborative Edge Computing

Multi-access edge computing (MEC) is a promising technology to enhance t...
research
01/30/2023

V2N Service Scaling with Deep Reinforcement Learning

The fifth generation (5G) of wireless networks is set out to meet the st...
research
04/22/2023

Towards Carbon-Neutral Edge Computing: Greening Edge AI by Harnessing Spot and Future Carbon Markets

Provisioning dynamic machine learning (ML) inference as a service for ar...
research
02/10/2021

Adaptive Processor Frequency Adjustment for Mobile Edge Computing with Intermittent Energy Supply

With astonishing speed, bandwidth, and scale, Mobile Edge Computing (MEC...

Please sign up or login with your details

Forgot password? Click here to reset