CoTV: Cooperative Control for Traffic Light Signals and Connected Autonomous Vehicles using Deep Reinforcement Learning

01/31/2022
by   Jiaying Guo, et al.
0

The target of reducing travel time only is insufficient to support the development of future smart transportation systems. To align with the United Nations Sustainable Development Goals (UN-SDG), a further reduction of fuel and emissions, improvements of traffic safety, and the ease of infrastructure deployment and maintenance should also be considered. Different from existing work focusing on the optimization of the control in either traffic light signal (to improve the intersection throughput), or vehicle speed (to stabilize the traffic), this paper presents a multi-agent deep reinforcement learning (DRL) system called CoTV, which Cooperatively controls both Traffic light signals and connected autonomous Vehicles (CAV). Therefore, our CoTV can well balance the achievement of the reduction of travel time, fuel, and emission. In the meantime, CoTV can also be easy to deploy by cooperating with only one CAV that is the nearest to the traffic light controller on each incoming road. This enables more efficient coordination between traffic light controllers and CAV, thus leading to the convergence of training CoTV under the large-scale multi-agent scenario that is traditionally difficult to converge. We give the detailed system design of CoTV, and demonstrate its effectiveness in a simulation study using SUMO under various grid maps and realistic urban scenarios with mixed-autonomy traffic.

READ FULL TEXT

page 1

page 6

page 7

page 10

research
02/23/2020

Optimizing Traffic Lights with Multi-agent Deep Reinforcement Learning and V2X communication

We consider a system to optimize duration of traffic signals using multi...
research
05/03/2022

Real-time Cooperative Vehicle Coordination at Unsignalized Road Intersections

Cooperative coordination at unsignalized road intersections, which aims ...
research
02/23/2023

Inequity aversion reduces travel time in the traffic light control problem

The traffic light control problem is to improve the traffic flow by coor...
research
04/05/2023

HumanLight: Incentivizing Ridesharing via Human-centric Deep Reinforcement Learning in Traffic Signal Control

Single occupancy vehicles are the most attractive transportation alterna...
research
04/25/2019

A Method for Expressing and Displaying the Vehicle Behavior Distribution in Maintenance Work Zones

Maintenance work zones on the road network have impacts on the normal tr...
research
02/03/2017

Traffic Lights with Auction-Based Controllers: Algorithms and Real-World Data

Real-time optimization of traffic flow addresses important practical pro...

Please sign up or login with your details

Forgot password? Click here to reset