Optimizing V2V Unicast Communication Transmission with Reinforcement Learning and Vehicle Clustering

by   Yu Wang, et al.

Efficient routing algorithms based on vehicular ad hoc networks (VANETs) play an important role in emerging intelligent transportation systems. This highly dynamic topology faces a number of wireless communication service challenges. In this paper, we propose a protocol based on reinforcement learning and vehicle node clustering, the protocol is called Qucts, solve vehicle-to-fixed-destination or V2V messaging problems. Improve message delivery rates with minimal hops and latency, link stability is also taken into account. The agreement is divided into three levels, first cluster the vehicles, each cluster head broadcasts its own coordinates and speed, to get more cluster members. Also when a cluster member receives another cluster head broadcast message, the cluster head generates a list of surrounding clusters, find the best cluster to the destination as the next cluster during message passing. Second, the protocol constructs a Q-value table based on the state after clustering, used to participate in the selection of messaging clusters. Finally, we introduce parameters that express the stability of the vehicle within the cluster, for communication node selection. This protocol hierarchy makes Qucts an offline and online solution. In order to distinguish unstable nodes within a cluster, Coding of each road, will have vehicles with planned routes, For example, car hailing and public bus. Compare the overlap with other planned paths vehicles in the cluster, low overlap is labeled as unstable nodes. Vehicle path overlap rate without a planned path is set to the mean value. Comparing Qucts with existing routing protocols through simulation, Our proposed Qucts scheme provides large improvements in both data delivery rate and end-to-end delay reduction.


Stable Dynamic Predictive Clustering (SDPC) Protocol for Vehicular Ad hoc Network

Vehicular communication is an essential part of a smart city. Scalabilit...

Applicability of overlay non-delay tolerant position-based protocols in highways and urban environments for vanet

Vehicular Ad hoc Network (VANET) is a new sort of wireless ad-hoc networ...

Data Fast Transmission Method in Wireless Vehicle Ad-hoc Network

ABSTRACT: In vehicular ad hoc networks, the current method does not cons...

Performance Evaluation of Ad Hoc Multicast Routing Protocols to Facilitate Video Streaming in VANETS

Vehicular Ad Hoc Network (VANET) is a type of mobile ad hoc network (MAN...

A Spectrum Aware Mobility Pattern Based Routing Protocol for CR-VANETs

Cognitive radio technology offers an important function in the efficient...

Bus Trajectory-Based Street-Centric Routing for Message Delivery in Urban Vehicular Ad hoc Networks

This paper focuses on the routing algorithm for the communications betwe...

DHRL-FNMR: An Intelligent Multicast Routing Approach Based on Deep Hierarchical Reinforcement Learning in SDN

The optimal multicast tree problem in the Software-Defined Networking (S...

Please sign up or login with your details

Forgot password? Click here to reset