Altruistic Maneuver Planning for Cooperative Autonomous Vehicles Using Multi-agent Advantage Actor-Critic

07/12/2021
by   Behrad Toghi, et al.
0

With the adoption of autonomous vehicles on our roads, we will witness a mixed-autonomy environment where autonomous and human-driven vehicles must learn to co-exist by sharing the same road infrastructure. To attain socially-desirable behaviors, autonomous vehicles must be instructed to consider the utility of other vehicles around them in their decision-making process. Particularly, we study the maneuver planning problem for autonomous vehicles and investigate how a decentralized reward structure can induce altruism in their behavior and incentivize them to account for the interest of other autonomous and human-driven vehicles. This is a challenging problem due to the ambiguity of a human driver's willingness to cooperate with an autonomous vehicle. Thus, in contrast with the existing works which rely on behavior models of human drivers, we take an end-to-end approach and let the autonomous agents to implicitly learn the decision-making process of human drivers only from experience. We introduce a multi-agent variant of the synchronous Advantage Actor-Critic (A2C) algorithm and train agents that coordinate with each other and can affect the behavior of human drivers to improve traffic flow and safety.

READ FULL TEXT

page 2

page 3

page 7

research
11/22/2022

Learning-based social coordination to improve safety and robustness of cooperative autonomous vehicles in mixed traffic

It is expected that autonomous vehicles(AVs) and heterogeneous human-dri...
research
07/02/2021

Cooperative Autonomous Vehicles that Sympathize with Human Drivers

Widespread adoption of autonomous vehicles will not become a reality unt...
research
05/05/2021

Calibration of Human Driving Behavior and Preference Using Naturalistic Traffic Data

Understanding human driving behaviors quantitatively is critical even in...
research
02/08/2023

Shared Information-Based Safe And Efficient Behavior Planning For Connected Autonomous Vehicles

The recent advancements in wireless technology enable connected autonomo...
research
11/05/2019

Liability Design for Autonomous Vehicles and Human-Driven Vehicles: A Hierarchical Game-Theoretic Approach

Autonomous vehicles (AVs) are inevitably entering our lives with potenti...
research
03/21/2023

Infrastructure-based End-to-End Learning and Prevention of Driver Failure

Intelligent intersection managers can improve safety by detecting danger...
research
08/02/2021

Risk Adversarial Learning System for Connected and Autonomous Vehicle Charging

In this paper, the design of a rational decision support system (RDSS) f...

Please sign up or login with your details

Forgot password? Click here to reset