GamePlan: Game-Theoretic Multi-Agent Planning with Human Drivers at Intersections, Roundabouts, and Merging

09/04/2021
by   Rohan Chandra, et al.
0

We present a new method for multi-agent planning involving human drivers and autonomous vehicles (AVs) in unsignaled intersections, roundabouts, and during merging. In multi-agent planning, the main challenge is to predict the actions of other agents, especially human drivers, as their intentions are hidden from other agents. Our algorithm uses game theory to develop a new auction, called GamePlan, that directly determines the optimal action for each agent based on their driving style (which is observable via commonly available sensors). GamePlan assigns a higher priority to more aggressive or impatient drivers and a lower priority to more conservative or patient drivers; we theoretically prove that such an approach is game-theoretically optimal prevents collisions and deadlocks. We compare our approach with prior state-of-the-art auction techniques including economic auctions, time-based auctions (first-in first-out), and random bidding and show that each of these methods result in collisions among agents when taking into account driver behavior. We additionally compare with methods based on deep reinforcement learning, deep learning, and game theory and present our benefits over these approaches. Finally, we show that our approach can be implemented in the real-world with human drivers.

READ FULL TEXT

page 1

page 7

research
05/01/2022

Game-Theoretic Planning for Autonomous Driving among Risk-Aware Human Drivers

We present a novel approach for risk-aware planning with human agents in...
research
02/23/2022

GAMEOPT: Optimal Real-time Multi-Agent Planning and Control at Dynamic Intersections

We propose GameOpt: a novel hybrid approach to cooperative intersection ...
research
06/26/2019

Cooperation-Aware Reinforcement Learning for Merging in Dense Traffic

Decision making in dense traffic can be challenging for autonomous vehic...
research
10/23/2018

Agent-Based Modeling and Simulation of Connected and Automated Vehicles Using Game Engine: A Cooperative On-Ramp Merging Study

Agent-based modeling and simulation (ABMS) has been a popular approach t...
research
04/21/2021

Contingencies from Observations: Tractable Contingency Planning with Learned Behavior Models

Humans have a remarkable ability to make decisions by accurately reasoni...
research
11/03/2017

People as Sensors: Imputing Maps from Human Actions

Despite growing attention in autonomy, there are still many open problem...
research
03/04/2019

Microscopic Traffic Simulation by Cooperative Multi-agent Deep Reinforcement Learning

Expert human drivers perform actions relying on traffic laws and their p...

Please sign up or login with your details

Forgot password? Click here to reset