A Hysteretic Q-learning Coordination Framework for Emerging Mobility Systems in Smart Cities

11/05/2020
by   Behdad Chalaki, et al.
0

Connected and automated vehicles (CAVs) can alleviate traffic congestion, air pollution, and improve safety. In this paper, we provide a decentralized coordination framework for CAVs at a signal-free intersection to minimize travel time and improve fuel efficiency. We employ a simple yet powerful reinforcement learning approach, an off-policy temporal difference learning called Q-learning, enhanced with a coordination mechanism to address this problem. Then, we integrate a first-in-first-out queuing policy to improve the performance of our system. We demonstrate the efficacy of our proposed approach through simulation and comparison with the classical optimal control method based on Pontryagin's minimum principle.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/23/2021

A Multi-Agent Deep Reinforcement Learning Coordination Framework for Connected and Automated Vehicles at Merging Roadways

The steady increase in the number of vehicles operating on the highways ...
research
01/12/2023

Learning to Control and Coordinate Hybrid Traffic Through Robot Vehicles at Complex and Unsignalized Intersections

Intersections are essential road infrastructures for traffic in modern m...
research
11/11/2019

Hierarchical Optimal Coordination Framework for Connected and Automated Vehicles in Multiple Intersections

In this paper, we present a decentralized optimal control framework for ...
research
08/01/2020

V2I Connectivity-Based Dynamic Queue-Jump Lane for Emergency Vehicles: A Deep Reinforcement Learning Approach

Emergency vehicle (EMV) service is a key function of cities and is excee...
research
11/18/2021

A Case Study on Optimization of Platooning Coordination

In today's world, circumstances, processes, and requirements for softwar...

Please sign up or login with your details

Forgot password? Click here to reset