Uncovering Interpretable Internal States of Merging Tasks at Highway On-Ramps for Autonomous Driving Decision-Making

02/15/2021
by   Huanjie Wang, et al.
0

Humans make daily-routine decisions based on their internal states in intricate interaction scenarios. This paper presents a probabilistically reconstructive learning approach to identify the internal states of multi-vehicle sequential interactions when merging at highway on-ramps. We treated the merging task's sequential decision as a dynamic, stochastic process and then integrated the internal states into an HMM-GMR model, a probabilistic combination of an extended Gaussian mixture regression (GMR) and hidden Markov models (HMM). We also developed a variant expectation-maximum (EM) algorithm to estimate the model parameters and verified them based on a real-world data set. Experimental results reveal that the interactive merge procedure at highway on-ramps can be semantically described by three interpretable internal states. This finding provides a basis for autonomous vehicles to develop a model-based decision-making algorithm in a partially observable environment.

READ FULL TEXT

page 1

page 3

page 12

research
08/14/2020

On Social Interactions of Merging Behaviors at Highway On-Ramps in Congested Traffic

Merging at highway on-ramps while interacting with other human-driven ve...
research
03/29/2023

Decision Making for Autonomous Driving in Interactive Merge Scenarios via Learning-based Prediction

Autonomous agents that drive on roads shared with human drivers must rea...
research
04/12/2019

Interaction-aware Decision Making with Adaptive Strategies under Merging Scenarios

In order to drive safely and efficiently under merging scenarios, autono...
research
04/19/2023

End-to-End Policy Gradient Method for POMDPs and Explainable Agents

Real-world decision-making problems are often partially observable, and ...
research
02/02/2017

The Value of Inferring the Internal State of Traffic Participants for Autonomous Freeway Driving

Safe interaction with human drivers is one of the primary challenges for...
research
09/07/2017

Formulation of Deep Reinforcement Learning Architecture Toward Autonomous Driving for On-Ramp Merge

Multiple automakers have in development or in production automated drivi...
research
07/19/2019

Interpretable Modelling of Driving Behaviors in Interactive Driving Scenarios based on Cumulative Prospect Theory

Understanding human driving behavior is important for autonomous vehicle...

Please sign up or login with your details

Forgot password? Click here to reset