Knowledge-Driven Multi-Agent Reinforcement Learning for Computation Offloading in Cybertwin-Enabled Internet of Vehicles

by   Ruijin Sun, et al.

By offloading computation-intensive tasks of vehicles to roadside units (RSUs), mobile edge computing (MEC) in the Internet of Vehicles (IoV) can relieve the onboard computation burden. However, existing model-based task offloading methods suffer from heavy computational complexity with the increase of vehicles and data-driven methods lack interpretability. To address these challenges, in this paper, we propose a knowledge-driven multi-agent reinforcement learning (KMARL) approach to reduce the latency of task offloading in cybertwin-enabled IoV. Specifically, in the considered scenario, the cybertwin serves as a communication agent for each vehicle to exchange information and make offloading decisions in the virtual space. To reduce the latency of task offloading, a KMARL approach is proposed to select the optimal offloading option for each vehicle, where graph neural networks are employed by leveraging domain knowledge concerning graph-structure communication topology and permutation invariance into neural networks. Numerical results show that our proposed KMARL yields higher rewards and demonstrates improved scalability compared with other methods, benefitting from the integration of domain knowledge.


Learning Based Task Offloading in Digital Twin Empowered Internet of Vehicles

Mobile edge computing has become an effective and fundamental paradigm f...

Energy-Delay Minimization of Task Migration Based on Game Theory in MEC-assisted Vehicular Networks

Roadside units (RSUs), which have strong computing capability and are cl...

AI-Empowered Data Offloading in MEC-Enabled IoV Networks

Advancements in smart vehicle design have enabled the creation of Intern...

Multi-Task Offloading via Graph Neural Networks in Heterogeneous Multi-access Edge Computing

In the rapidly evolving field of Heterogeneous Multi-access Edge Computi...

Learning-based Sustainable Multi-User Computation Offloading for Mobile Edge-Quantum Computing

In this paper, a novel paradigm of mobile edge-quantum computing (MEQC) ...

An Evaluation of WebAssembly and eBPF as Offloading Mechanisms in the Context of Computational Storage

As the volume of data that needs to be processed continues to increase, ...

Please sign up or login with your details

Forgot password? Click here to reset