Multi-Agent Reinforcement Learning for Joint Channel Assignment and Power Allocation in Platoon-Based C-V2X Systems

by   Hung V. Vu, et al.

We consider the problem of joint channel assignment and power allocation in underlaid cellular vehicular-to-everything (C-V2X) systems where multiple vehicle-to-infrastructure (V2I) uplinks share the time-frequency resources with multiple vehicle-to-vehicle (V2V) platoons that enable groups of connected and autonomous vehicles to travel closely together. Due to the nature of fast channel variant in vehicular environment, traditional centralized optimization approach relying on global channel information might not be viable in C-V2X systems with large number of users. Utilizing a reinforcement learning (RL) approach, we propose a distributed resource allocation (RA) algorithm to overcome this challenge. Specifically, we model the RA problem as a multi-agent system. Based solely on the local channel information, each platoon leader, who acts as an agent, collectively interacts with each other and accordingly selects the optimal combination of sub-band and power level to transmit its signals. Toward this end, we utilize the double deep Q-learning algorithm to jointly train the agents under the objectives of simultaneously maximizing the V2I sum-rate and satisfying the packet delivery probability of each V2V link in a desired latency limitation. Simulation results show that our proposed RL-based algorithm achieves a close performance compared to that of the well-known exhaustive search algorithm.


Platoon Leader Selection, User Association and Resource Allocation on a C-V2X based highway: A Reinforcement Learning Approach

We consider the problem of dynamic platoon leader selection, user associ...

Spectrum Sharing in Vehicular Networks Based on Multi-Agent Reinforcement Learning

This paper investigates the spectrum sharing problem in vehicular networ...

An approach to implement Reinforcement Learning for Heterogeneous Vehicular Networks

This paper presents the extension of the idea of spectrum sharing in the...

Multi Agent DeepRL based Joint Power and Subchannel Allocation in IAB networks

Integrated Access and Backhauling (IAB) is a viable approach for meeting...

Dynamic Power Allocation and Virtual Cell Formation for Throughput-Optimal Vehicular Edge Networks in Highway Transportation

In this paper, we address highly mobile vehicular networks from users' p...

Eco-Vehicular Edge Networks for Connected Transportation: A Decentralized Multi-Agent Reinforcement Learning Approach

This paper introduces an energy-efficient, software-defined vehicular ed...

AoI-Aware Resource Allocation for Platoon-Based C-V2X Networks via Multi-Agent Multi-Task Reinforcement Learning

This paper investigates the problem of age of information (AoI) aware ra...

Please sign up or login with your details

Forgot password? Click here to reset