Network slicing for vehicular communications: a multi-agent deep reinforcement learning approach

01/27/2022
by   Zoubeir Mlika, et al.
0

This paper studies the multi-agent resource allocation problem in vehicular networks using non-orthogonal multiple access (NOMA) and network slicing. To ensure heterogeneous service requirements for different vehicles, we propose a network slicing architecture. We focus on a non-cellular network scenario where vehicles communicate by the broadcast approach via the direct device-to-device interface. In such a vehicular network, resource allocation among vehicles is very difficult, mainly due to (i) the rapid variation of wireless channels among highly mobile vehicles and (ii) the lack of a central coordination point. Thus, the possibility of acquiring instantaneous channel state information to perform centralized resource allocation is precluded. The resource allocation problem considered is therefore very complex. It includes not only the usual spectrum and power allocation, but also coverage selection (which target vehicles to broadcast to) and packet selection (which network slice to use). This problem must be solved jointly since selected packets can be overlaid using NOMA and therefore spectrum and power must be carefully allocated for better vehicle coverage. To do so, we provide a optimization approach and study the NP-hardness of the problem. Then, we model the problem using multi-agent Markov decision process. Finally, we use a deep reinforcement learning (DRL) approach to solve the problem. The proposed DRL algorithm is practical because it can be implemented in an online and distributed manner. We show that our approach is robust and efficient when faced with different variations of the network parameters and compared to centralized benchmarks.

READ FULL TEXT

page 20

page 23

page 24

page 25

research
01/27/2022

Network Slicing with MEC and Deep Reinforcement Learning for the Internet of Vehicles

The interconnection of vehicles in the future fifth generation (5G) wire...
research
08/14/2020

Multi-Agent Deep Reinforcement Learning enabled Computation Resource Allocation in a Vehicular Cloud Network

In this paper, we investigate the computational resource allocation prob...
research
10/18/2022

Deep Deterministic Policy Gradient to Minimize the Age of Information in Cellular V2X Communications

This paper studies the problem of minimizing the age of information (AoI...
research
05/05/2022

Multi-Agent Deep Reinforcement Learning in Vehicular OCC

Optical camera communications (OCC) has emerged as a key enabling techno...
research
08/26/2022

An approach to implement Reinforcement Learning for Heterogeneous Vehicular Networks

This paper presents the extension of the idea of spectrum sharing in the...
research
01/09/2023

Platoon Leader Selection, User Association and Resource Allocation on a C-V2X based highway: A Reinforcement Learning Approach

We consider the problem of dynamic platoon leader selection, user associ...
research
08/27/2021

Deep Reinforcement Learning for Wireless Resource Allocation Using Buffer State Information

As the number of user equipments (UEs) with various data rate and latenc...

Please sign up or login with your details

Forgot password? Click here to reset