Microscopic Traffic Simulation by Cooperative Multi-agent Deep Reinforcement Learning

03/04/2019
by   Giulio Bacchiani, et al.
0

Expert human drivers perform actions relying on traffic laws and their previous experience. While traffic laws are easily embedded into an artificial brain, modeling human complex behaviors which come from past experience is a more challenging task. One of these behaviors is the capability of communicating intentions and negotiating the right of way through driving actions, as when a driver is entering a crowded roundabout and observes other cars movements to guess the best time to merge in. In addition, each driver has its own unique driving style, which is conditioned by both its personal characteristics, such as age and quality of sight, and external factors, such as being late or in a bad mood. For these reasons, the interaction between different drivers is not trivial to simulate in a realistic manner. In this paper, this problem is addressed by developing a microscopic simulator using a Deep Reinforcement Learning Algorithm based on a combination of visual frames, representing the perception around the vehicle, and a vector of numerical parameters. In particular, the algorithm called Asynchronous Advantage Actor-Critic has been extended to a multi-agent scenario in which every agent needs to learn to interact with other similar agents. Moreover, the model includes a novel architecture such that the driving style of each vehicle is adjustable by tuning some of its input parameters, permitting to simulate drivers with different levels of aggressiveness and desired cruising speeds.

READ FULL TEXT
research
12/26/2020

Generation of Traffic Flows in Multi-Agent Traffic Simulation with Agent Behavior Model based on Deep Reinforcement Learning

In multi-agent based traffic simulation, agents are always supposed to m...
research
01/12/2020

Learning to drive via Apprenticeship Learning and Deep Reinforcement Learning

With the implementation of reinforcement learning (RL) algorithms, curre...
research
01/15/2023

Modeling Human Cognition with a Hybrid Deep Reinforcement Learning Agent

Human cognition model could help us gain insights in how human cognition...
research
08/03/2016

Learning a Driving Simulator

Comma.ai's approach to Artificial Intelligence for self-driving cars is ...
research
09/04/2021

GamePlan: Game-Theoretic Multi-Agent Planning with Human Drivers at Intersections, Roundabouts, and Merging

We present a new method for multi-agent planning involving human drivers...
research
12/21/2022

CarFi: Rider Localization Using Wi-Fi CSI

With the rise of hailing services, people are increasingly relying on sh...
research
02/26/2020

When Do Drivers Concentrate? Attention-based Driver Behavior Modeling With Deep Reinforcement Learning

Driver distraction a significant risk to driving safety. Apart from spat...

Please sign up or login with your details

Forgot password? Click here to reset