Learning Based Task Offloading in Digital Twin Empowered Internet of Vehicles

by   Jinkai Zheng, et al.

Mobile edge computing has become an effective and fundamental paradigm for futuristic autonomous vehicles to offload computing tasks. However, due to the high mobility of vehicles, the dynamics of the wireless conditions, and the uncertainty of the arrival computing tasks, it is difficult for a single vehicle to determine the optimal offloading strategy. In this paper, we propose a Digital Twin (DT) empowered task offloading framework for Internet of Vehicles. As a software agent residing in the cloud, a DT can obtain both global network information by using communications among DTs, and historical information of a vehicle by using the communications within the twin. The global network information and historical vehicular information can significantly facilitate the offloading. In specific, to preserve the precious computing resource at different levels for most appropriate computing tasks, we integrate a learning scheme based on the prediction of futuristic computing tasks in DT. Accordingly, we model the offloading scheduling process as a Markov Decision Process (MDP) to minimize the long-term cost in terms of a trade off between task latency, energy consumption, and renting cost of clouds. Simulation results demonstrate that our algorithm can effectively find the optimal offloading strategy, as well as achieve the fast convergence speed and high performance, compared with other existing approaches.


Delay-sensitive Task Offloading in Vehicular Fog Computing-Assisted Platoons

Vehicles in platoons need to process many tasks to support various real-...

Knowledge-Driven Multi-Agent Reinforcement Learning for Computation Offloading in Cybertwin-Enabled Internet of Vehicles

By offloading computation-intensive tasks of vehicles to roadside units ...

SAGE: A Split-Architecture Methodology for Efficient End-to-End Autonomous Vehicle Control

Autonomous vehicles (AV) are expected to revolutionize transportation an...

Cost- and Energy-Aware Multi-Flow Mobile Data Offloading Using Markov Decision Process

With the rapid increase in demand for mobile data, mobile network operat...

CoMap: Proactive Provision for Crowdsourcing Map in Automotive Edge Computing

Crowdsourcing data from connected and automated vehicles (CAVs) is a cos...

Efficient Mining Cluster Selection for Blockchain-based Cellular V2X Communications

Cellular vehicle-to-everything (V2X) communication is expected to herald...

Intelligent Task Offloading for Heterogeneous V2X Communications

With the rapid development of autonomous driving technologies, it become...

Please sign up or login with your details

Forgot password? Click here to reset