Dynamic network congestion pricing based on deep reinforcement learning

06/24/2022
by   Kimihiro Sato, et al.
0

Traffic congestion is a serious problem in urban areas. Dynamic congestion pricing is one of the useful schemes to eliminate traffic congestion in strategic scale. However, in the reality, an optimal dynamic congestion pricing is very difficult or impossible to determine theoretically, because road networks are usually large and complicated, and behavior of road users is uncertain. To account for this challenge, this work proposes a dynamic congestion pricing method using deep reinforcement learning (DRL). It is designed to eliminate traffic congestion based on observable data in general large-scale road networks, by leveraging the data-driven nature of deep reinforcement learning. One of the novel elements of the proposed method is the distributed and cooperative learning scheme. Specifically, the DRL is implemented by a spatial-temporally distributed manner, and cooperation among DRL agents is established by novel techniques we call spatially shared reward and temporally switching learning. It enables fast and computationally efficient learning in large-scale networks. The numerical experiments using Sioux Falls Network showed that the proposed method works well thanks to the novel learning scheme.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/04/2023

Demonstration-guided Deep Reinforcement Learning for Coordinated Ramp Metering and Perimeter Control in Large Scale Networks

Effective traffic control methods have great potential in alleviating ne...
research
03/17/2020

Watch your back: Backdoor Attacks in Deep Reinforcement Learning-based Autonomous Vehicle Control Systems

Autonomous Vehicles (AVs) with Deep Reinforcement Learning (DRL)-based c...
research
05/16/2023

Deep Reinforcement Learning to Maximize Arterial Usage during Extreme Congestion

Collisions, crashes, and other incidents on road networks, if left unmit...
research
09/10/2023

AVARS – Alleviating Unexpected Urban Road Traffic Congestion using UAVs

Reducing unexpected urban traffic congestion caused by en-route events (...
research
03/24/2023

Optimal Smoothing Distribution Exploration for Backdoor Neutralization in Deep Learning-based Traffic Systems

Deep Reinforcement Learning (DRL) enhances the efficiency of Autonomous ...
research
08/07/2019

Large-scale traffic signal control using machine learning: some traffic flow considerations

This paper uses supervised learning, random search and deep reinforcemen...
research
08/23/2022

Large-Scale Traffic Congestion Prediction based on Multimodal Fusion and Representation Mapping

With the progress of the urbanisation process, the urban transportation ...

Please sign up or login with your details

Forgot password? Click here to reset