Learning-based Incentive Mechanism for Task Freshness-aware Vehicular Twin Migration

09/10/2023
by   Junhong Zhang, et al.
0

Vehicular metaverses are an emerging paradigm that integrates extended reality technologies and real-time sensing data to bridge the physical space and digital spaces for intelligent transportation, providing immersive experiences for Vehicular Metaverse Users (VMUs). VMUs access the vehicular metaverse by continuously updating Vehicular Twins (VTs) deployed on nearby RoadSide Units (RSUs). Due to the limited RSU coverage, VTs need to be continuously online migrated between RSUs to ensure seamless immersion and interactions for VMUs with the nature of mobility. However, the VT migration process requires sufficient bandwidth resources from RSUs to enable online and fast migration, leading to a resource trading problem between RSUs and VMUs. To this end, we propose a learning-based incentive mechanism for migration task freshness-aware VT migration in vehicular metaverses. To quantify the freshness of the VT migration task, we first propose a new metric named Age of Twin Migration (AoTM), which measures the time elapsed of completing the VT migration task. Then, we propose an AoTM-based Stackelberg model, where RSUs act as the leader and VMUs act as followers. Due to incomplete information between RSUs and VMUs caused by privacy and security concerns, we utilize deep reinforcement learning to learn the equilibrium of the Stackelberg game. Numerical results demonstrate the effectiveness of our proposed learning-based incentive mechanism for vehicular metaverses.

READ FULL TEXT

page 1

page 6

research
06/26/2023

Multi-Agent Deep Reinforcement Learning for Dynamic Avatar Migration in AIoT-enabled Vehicular Metaverses with Trajectory Prediction

Avatars, as promising digital assistants in Vehicular Metaverses, can en...
research
01/27/2022

A Deep Reinforcement Learning Approach for Service Migration in MEC-enabled Vehicular Networks

Multi-access edge computing (MEC) is a key enabler to reduce the latency...
research
06/14/2019

Permissioned Blockchain for Efficient and Secure Resource Sharing in Vehicular Edge Computing

With the fast expanding scale of vehicular networks, vehicular edge comp...
research
11/12/2019

MSDF: A Deep Reinforcement Learning Framework for Service Function Chain Migration

Under dynamic traffic, service function chain (SFC) migration is conside...
research
12/08/2018

Crowdsensing Game with Demand Uncertainties: A Deep Reinforcement Learning Approach

Currently, explosive increase of smartphones with powerful built-in sens...
research
05/28/2018

Reinforcement Learning for Resource Provisioning in Vehicular Cloud

This article presents a concise view of vehicular clouds that incorporat...
research
02/06/2023

PASCAL: A Learning-aided Cooperative Bandwidth Control Policy for Hierarchical Storage Systems

Nowadays, the Hierarchical Storage System (HSS) is considered as an idea...

Please sign up or login with your details

Forgot password? Click here to reset