Spectrum Sharing in Vehicular Networks Based on Multi-Agent Reinforcement Learning

05/08/2019
by   Le Liang, et al.
0

This paper investigates the spectrum sharing problem in vehicular networks based on multi-agent reinforcement learning, where multiple vehicle-to-vehicle (V2V) links reuse the frequency spectrum preoccupied by vehicle-to-infrastructure (V2I) links. Fast channel variations in high mobility vehicular environments preclude the possibility of collecting accurate instantaneous channel state information at the base station for centralized resource management. In response, we model the resource sharing as a multi-agent reinforcement learning problem, which is then solved using a fingerprint-based deep Q-network method and amenable to a distributed implementation. The V2V links, each acting as an agent, collectively interact with the communication environment, receive distinctive observations yet a common reward, and learn to improve spectrum and power allocation through updating Q-networks using the gained experiences. We demonstrate that with a proper reward design and training mechanism, the multiple V2V agents successfully learn to cooperate in a distributed way to simultaneously improve the sum capacity of V2I links and success probability of payload delivery for V2V links.

READ FULL TEXT
research
08/26/2022

An approach to implement Reinforcement Learning for Heterogeneous Vehicular Networks

This paper presents the extension of the idea of spectrum sharing in the...
research
01/08/2018

Graph-Based Radio Resource Management for Vehicular Networks

This paper investigates the resource allocation problem in device-to-dev...
research
07/13/2021

Transfer Learning in Multi-Agent Reinforcement Learning with Double Q-Networks for Distributed Resource Sharing in V2X Communication

This paper addresses the problem of decentralized spectrum sharing in ve...
research
01/09/2023

Platoon Leader Selection, User Association and Resource Allocation on a C-V2X based highway: A Reinforcement Learning Approach

We consider the problem of dynamic platoon leader selection, user associ...
research
11/09/2020

Multi-Agent Reinforcement Learning for Joint Channel Assignment and Power Allocation in Platoon-Based C-V2X Systems

We consider the problem of joint channel assignment and power allocation...
research
08/12/2019

Learn to Compress CSI and Allocate Resources in Vehicular Networks

Resource allocation has a direct and profound impact on the performance ...
research
05/10/2021

AoI-Aware Resource Allocation for Platoon-Based C-V2X Networks via Multi-Agent Multi-Task Reinforcement Learning

This paper investigates the problem of age of information (AoI) aware ra...

Please sign up or login with your details

Forgot password? Click here to reset