Reinforcement Learning Scheduler for Vehicle-to-Vehicle Communications Outside Coverage

04/29/2019
by   Taylan Şahin, et al.
0

Radio resources in vehicle-to-vehicle (V2V) communication can be scheduled either by a centralized scheduler residing in the network (e.g., a base station in case of cellular systems) or a distributed scheduler, where the resources are autonomously selected by the vehicles. The former approach yields a considerably higher resource utilization in case the network coverage is uninterrupted. However, in case of intermittent or out-of-coverage, due to not having input from centralized scheduler, vehicles need to revert to distributed scheduling. Motivated by recent advances in reinforcement learning (RL), we investigate whether a centralized learning scheduler can be taught to efficiently pre-assign the resources to vehicles for out-of-coverage V2V communication. Specifically, we use the actor-critic RL algorithm to train the centralized scheduler to provide non-interfering resources to vehicles before they enter the out-of-coverage area. Our initial results show that a RL-based scheduler can achieve performance as good as or better than the state-of-art distributed scheduler, often outperforming it. Furthermore, the learning process completes within a reasonable time (ranging from a few hundred to a few thousand epochs), thus making the RL-based scheduler a promising solution for V2V communications with intermittent network coverage.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

research
07/22/2019

VRLS: A Unified Reinforcement Learning Scheduler for Vehicle-to-Vehicle Communications

Vehicle-to-vehicle (V2V) communications have distinct challenges that ne...
research
07/13/2022

Scheduling Out-of-Coverage Vehicular Communications Using Reinforcement Learning

Performance of vehicle-to-vehicle (V2V) communications depends highly on...
research
10/26/2018

Deep-Reinforcement-Learning-Based Distributed Vehicle Position Controls for Coverage Expansion in mmWave V2X

In millimeter wave (mmWave) vehicular communications, multi-hop relay di...
research
01/03/2021

Environment-Adaptive Multiple Access for Distributed V2X Network: A Reinforcement Learning Framework

The huge research interest in cellular vehicle-to-everything (C-V2X) com...
research
02/03/2023

Reinforcement Learning and Distributed Model Predictive Control for Conflict Resolution in Highly Constrained Spaces

This work presents a distributed algorithm for resolving cooperative mul...
research
04/29/2019

Radio Resource Allocation for Reliable Out-of-coverage V2V Communications

We explore a new approach to radio resource allocation for vehicle-to-ve...
research
12/18/2019

Centralized Conflict-free Cooperation for Connected and Automated Vehicles at Intersections by Proximal Policy Optimization

Connected vehicles will change the modes of future transportation manage...

Please sign up or login with your details

Forgot password? Click here to reset