DynLight: Realize dynamic phase duration with multi-level traffic signal control

04/07/2022
by   Liang Zhang, et al.
0

Adopting reinforcement learning (RL) for traffic signal control is increasingly popular. Most RL methods use fixed action interval (denoted as tduration) and actuate or maintain a phase every tduration, which makes the phase duration less dynamic and flexible. In addition, the actuated phase can be arbitrary, affecting the real-world deployment, which requires a fixed cyclical phase structure. To address these challenges, we propose a multi-level traffic signal control framework, DynLight, which uses an optimization method Max-QueueLength (M-QL) to determine the phase and uses a deep Q-network to determine the corresponding duration. Based on DynLight, we further propose DynLight-C that adopts a well trained deep Q-network of DynLight and replace M-QL by a fixed cyclical control policy that actuate a set of phases in fixed order to realize cyclical phase structure. Comprehensive experiments on multiple real-world datasets demonstrate that DynLight achives a new state-of-the-art. Furthermore, the deep Q-network of DynLight can learn well on determining the phase duration and DynLight-C demonstrates high performance for deployment.

READ FULL TEXT
research
11/02/2022

DynamicLight: Dynamically Tuning Traffic Signal Duration with DRL

Deep reinforcement learning (DRL) is becoming increasingly popular in im...
research
12/04/2021

Efficient Pressure: Improving efficiency for signalized intersections

Since conventional approaches could not adapt to dynamic traffic conditi...
research
06/21/2022

Safe and Psychologically Pleasant Traffic Signal Control with Reinforcement Learning using Action Masking

Reinforcement learning (RL) for traffic signal control (TSC) has shown b...
research
03/20/2023

Data Might be Enough: Bridge Real-World Traffic Signal Control Using Offline Reinforcement Learning

Applying reinforcement learning (RL) to traffic signal control (TSC) has...
research
12/19/2021

Expression is enough: Improving traffic signal control with advanced traffic state representation

Recently, finding fundamental properties for traffic state representatio...
research
11/23/2022

Reinforcement learning for traffic signal control in hybrid action space

The prevailing reinforcement-learning-based traffic signal control metho...
research
08/05/2020

Area-wide traffic signal control based on a deep graph Q-Network (DGQN) trained in an asynchronous manner

Reinforcement learning (RL) algorithms have been widely applied in traff...

Please sign up or login with your details

Forgot password? Click here to reset