ES-CTC: A Deep Neuroevolution Model for Cooperative Intelligent Freeway Traffic Control

05/10/2019
by   Yuankai Wu, et al.
0

Cooperative intelligent freeway traffic control is an important application in intelligent transportation systems, which is expected to improve the mobility of freeway networks. In this paper, we propose a deep neuroevolution model, called ES-CTC, to achieve a cooperative control scheme of ramp metering, differential variable speed limits and lane change control agents for improving freeway traffic. In this model, the graph convolutional networks are used to learn more meaningful spatial pattern from traffic sensors, a knowledge sharing layer is designed for communication between different agents. The proposed neural networks structure allows different agents share knowledge with each other and execute action asynchronously. In order to address the delayed reward and action asynchronism issues, the evolutionary strategy is utilized to train the agents under stochastic traffic demands. The experimental results on a simulated freeway section indicate that ES-CTC is a viable approach and outperforms several existing methods

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/29/2021

Learning to Communicate with Reinforcement Learning for an Adaptive Traffic Control System

Recent work in multi-agent reinforcement learning has investigated inter...
research
04/22/2021

Independent Reinforcement Learning for Weakly Cooperative Multiagent Traffic Control Problem

The adaptive traffic signal control (ATSC) problem can be modeled as a m...
research
10/25/2018

Differential Variable Speed Limits Control for Freeway Recurrent Bottlenecks via Deep Reinforcement learning

Variable speed limits (VSL) control is a flexible way to improve traffic...
research
07/02/2022

Lane-GNN: Integrating GNN for Predicting Drivers' Lane Change Intention

Nowadays, intelligent highway traffic network is playing an important ro...
research
11/29/2021

Multi-UAV Conflict Resolution with Graph Convolutional Reinforcement Learning

Safety is the primary concern when it comes to air traffic. In-flight sa...
research
12/05/2022

Cooperative control of environmental extremes by artificial intelligent agents

Humans have been able to tackle biosphere complexities by acting as ecos...
research
09/20/2019

Intelligent Policing Strategy for Traffic Violation Prevention

Police officer presence at an intersection discourages a potential traff...

Please sign up or login with your details

Forgot password? Click here to reset