Modeling Interactions of Autonomous Vehicles and Pedestrians with Deep Multi-Agent Reinforcement Learning for Collision Avoidance

09/30/2021
by   Raphael Trumpp, et al.
0

Reliable pedestrian crash avoidance mitigation (PCAM) systems are crucial components of safe autonomous vehicles (AVs). The sequential nature of the vehicle-pedestrian interaction, i.e., where immediate decisions of one agent directly influence the following decisions of the other agent, is an often neglected but important aspect. In this work, we model the corresponding interaction sequence as a Markov decision process (MDP) that is solved by deep reinforcement learning (DRL) algorithms to define the PCAM system's policy. The simulated driving scenario is based on an AV acting as a DRL agent driving along an urban street, facing a pedestrian at an unmarked crosswalk who tries to cross. Since modeling realistic crossing behavior of the pedestrian is challenging, we introduce two levels of intelligent pedestrian behavior: While the baseline model follows a predefined strategy, our advanced model captures continuous learning and the inherent uncertainty in human behavior by defining the pedestrian as a second DRL agent, i.e., we introduce a deep multi-agent reinforcement learning (DMARL) problem. The presented PCAM system with different levels of intelligent pedestrian behavior is benchmarked according to the agents' collision rate and the resulting traffic flow efficiency. In this analysis, our focus lies on evaluating the influence of observation noise on the decision making of the agents. The results show that the AV is able to completely mitigate collisions under the majority of the investigated conditions and that the DRL-based pedestrian model indeed learns a more human-like crossing behavior.

READ FULL TEXT
research
01/25/2023

Deconstructing Pedestrian Crossing Decision-making in Interactions with Continuous Traffic: an Anthropomorphic Model

As safe and comfortable interactions with pedestrians could contribute t...
research
08/26/2020

Decision-making for Autonomous Vehicles on Highway: Deep Reinforcement Learning with Continuous Action Horizon

Decision-making strategy for autonomous vehicles de-scribes a sequence o...
research
03/14/2022

Intend-Wait-Cross: Towards Modeling Realistic Pedestrian Crossing Behavior

In this paper, we present a microscopic agent-based pedestrian behavior ...
research
04/25/2019

Pedestrian Collision Avoidance System for Scenarios with Occlusions

Safe autonomous driving in urban areas requires robust algorithms to avo...
research
06/13/2023

Using Collision Momentum in Deep Reinforcement Learning Based Adversarial Pedestrian Modeling

Recent research in pedestrian simulation often aims to develop realistic...
research
04/15/2019

Multi-Objective Autonomous Braking System using Naturalistic Dataset

A deep reinforcement learning based multi-objective autonomous braking s...
research
12/10/2021

A Reinforcement Learning-based Adaptive Control Model for Future Street Planning, An Algorithm and A Case Study

With the emerging technologies in Intelligent Transportation System (ITS...

Please sign up or login with your details

Forgot password? Click here to reset