Modeling Human Driving Behavior in Highway Scenario using Inverse Reinforcement Learning

10/07/2020
by   Zhiyu Huang, et al.
0

Human driving behavior modeling is of great importance for designing safe, smart, smooth as well as personalized autonomous driving systems. In this paper, an internal reward function-based driving model that emulates the human's internal decision-making mechanism is proposed. Besides, a sampling-based inverse reinforcement learning (IRL) algorithm that learns the reward function from human naturalistic driving data is also developed. A polynomial trajectory sampler is adopted to generate feasible trajectories and approximate the partition function in the maximum entropy IRL framework, and a dynamic and interactive environment is built upon the static driving dataset to estimate the generated trajectories considering the mutual dependency of agents' actions. The proposed method is applied to learn personalized reward functions for individual human drivers from the NGSIM dataset. The qualitative results demonstrate that the learned reward function is able to interpret their decisions. The quantitative results also reveal that the personalized modeling method significantly outperforms the general modeling approach, reducing the errors in human likeness by 24 delivers better results compared to other baseline methods. Moreover, it is found that estimating the response actions of surrounding vehicles plays an integral role in estimating the trajectory accurately and achieving a better generalization ability.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 8

research
06/22/2020

Efficient Sampling-Based Maximum Entropy Inverse Reinforcement Learning with Application to Autonomous Driving

In the past decades, we have witnessed significant progress in the domai...
research
07/28/2023

Does Unpredictability Influence Driving Behavior?

In this paper we investigate the effect of the unpredictability of surro...
research
10/09/2021

Active Altruism Learning and Information Sufficiency for Autonomous Driving

Safe interaction between vehicles requires the ability to choose actions...
research
07/11/2020

Planning on the fast lane: Learning to interact using attention mechanisms in path integral inverse reinforcement learning

General-purpose trajectory planning algorithms for automated driving uti...
research
08/20/2020

Expressing Diverse Human Driving Behavior with Probabilistic Rewards and Online Inference

In human-robot interaction (HRI) systems, such as autonomous vehicles, u...
research
09/05/2022

A New Approach to Training Multiple Cooperative Agents for Autonomous Driving

Training multiple agents to perform safe and cooperative control in the ...
research
07/10/2019

Regularizing Neural Networks for Future Trajectory Prediction via Inverse Reinforcement Learning

Predicting distant future trajectories of agents in a dynamic scene is n...

Please sign up or login with your details

Forgot password? Click here to reset