A Deep Reinforcement Learning Approach for Service Migration in MEC-enabled Vehicular Networks

01/27/2022
by   Amine Abouaomar, et al.
0

Multi-access edge computing (MEC) is a key enabler to reduce the latency of vehicular network. Due to the vehicles mobility, their requested services (e.g., infotainment services) should frequently be migrated across different MEC servers to guarantee their stringent quality of service requirements. In this paper, we study the problem of service migration in a MEC-enabled vehicular network in order to minimize the total service latency and migration cost. This problem is formulated as a nonlinear integer program and is linearized to help obtaining the optimal solution using off-the-shelf solvers. Then, to obtain an efficient solution, it is modeled as a multi-agent Markov decision process and solved by leveraging deep Q learning (DQL) algorithm. The proposed DQL scheme performs a proactive services migration while ensuring their continuity under high mobility constraints. Finally, simulations results show that the proposed DQL scheme achieves close-to-optimal performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/26/2023

Multi-Agent Deep Reinforcement Learning for Dynamic Avatar Migration in AIoT-enabled Vehicular Metaverses with Trajectory Prediction

Avatars, as promising digital assistants in Vehicular Metaverses, can en...
research
11/12/2019

MSDF: A Deep Reinforcement Learning Framework for Service Function Chain Migration

Under dynamic traffic, service function chain (SFC) migration is conside...
research
04/12/2023

DOSM: Demand-Prediction based Online Service Management for Vehicular Edge Computing Networks

In this work, we investigate an online service management problem in veh...
research
09/10/2023

Learning-based Incentive Mechanism for Task Freshness-aware Vehicular Twin Migration

Vehicular metaverses are an emerging paradigm that integrates extended r...
research
08/24/2023

Understanding Container-based Services under Software Aging: Dependability and Performance Views

Container technology, as the key enabler behind microservice architectur...
research
10/01/2022

Joint Mobility Control and MEC Offloading for Hybrid Satellite-Terrestrial-Network-Enabled Robots

Benefiting from the fusion of communication and intelligent technologies...
research
01/05/2022

Towards studying Service Function Chain Migration Patterns in 5G Networks and beyond

Given the indispensable need for a reliable network architecture to cope...

Please sign up or login with your details

Forgot password? Click here to reset