Partially Detected Intelligent Traffic Signal Control: Environmental Adaptation

10/23/2019
by   Rusheng Zhang, et al.
0

Partially Detected Intelligent Traffic Signal Control (PD-ITSC) systems that can optimize traffic signals based on limited detected information could be a cost-efficient solution for mitigating traffic congestion in the future. In this paper, we focus on a particular problem in PD-ITSC - adaptation to changing environments. To this end, we investigate different reinforcement learning algorithms, including Q-learning, Proximal Policy Optimization (PPO), Advantage Actor-Critic (A2C), and Actor-Critic with Kronecker-Factored Trust Region (ACKTR). Our findings suggest that RL algorithms can find optimal strategies under partial vehicle detection; however, policy-based algorithms can adapt to changing environments more efficiently than value-based algorithms. We use these findings to draw conclusions about the value of different models for PD-ITSC systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/03/2021

Traffic Signal Control with Communicative Deep Reinforcement Learning Agents: a Case Study

In this work we analyze Multi-Agent Advantage Actor-Critic (MA2C) a rece...
research
09/29/2021

Deep Reinforcement Q-Learning for Intelligent Traffic Signal Control with Partial Detection

Intelligent traffic signal controllers, applying DQN algorithms to traff...
research
08/03/2022

AACC: Asymmetric Actor-Critic in Contextual Reinforcement Learning

Reinforcement Learning (RL) techniques have drawn great attention in man...
research
06/07/2023

Adaptive Frequency Green Light Optimal Speed Advisory based on Hybrid Actor-Critic Reinforcement Learning

Green Light Optimal Speed Advisory (GLOSA) system suggests speeds to veh...
research
10/06/2020

Reinforcement Learning with Random Delays

Action and observation delays commonly occur in many Reinforcement Learn...
research
05/18/2022

A2C is a special case of PPO

Advantage Actor-critic (A2C) and Proximal Policy Optimization (PPO) are ...

Please sign up or login with your details

Forgot password? Click here to reset