Reinforcement Learning based Negotiation-aware Motion Planning of Autonomous Vehicles

07/08/2021
by   Zhitao Wang, et al.
0

For autonomous vehicles integrating onto roadways with human traffic participants, it requires understanding and adapting to the participants' intention and driving styles by responding in predictable ways without explicit communication. This paper proposes a reinforcement learning based negotiation-aware motion planning framework, which adopts RL to adjust the driving style of the planner by dynamically modifying the prediction horizon length of the motion planner in real time adaptively w.r.t the event of a change in environment, typically triggered by traffic participants' switch of intents with different driving styles. The framework models the interaction between the autonomous vehicle and other traffic participants as a Markov Decision Process. A temporal sequence of occupancy grid maps are taken as inputs for RL module to embed an implicit intention reasoning. Curriculum learning is employed to enhance the training efficiency and the robustness of the algorithm. We applied our method to narrow lane navigation in both simulation and real world to demonstrate that the proposed method outperforms the common alternative due to its advantage in alleviating the social dilemma problem with proper negotiation skills.

READ FULL TEXT

page 1

page 3

page 5

page 6

research
05/22/2020

An Integrated Framework of Decision Making and Motion Planning for Autonomous Vehicles Considering Social Behaviors

This paper presents a novel integrated approach to deal with the decisio...
research
07/09/2021

Learning Interaction-aware Guidance Policies for Motion Planning in Dense Traffic Scenarios

Autonomous navigation in dense traffic scenarios remains challenging for...
research
05/08/2020

Learning hierarchical behavior and motion planning for autonomous driving

Learning-based driving solution, a new branch for autonomous driving, is...
research
05/23/2020

Learning from Naturalistic Driving Data for Human-like Autonomous Highway Driving

Driving in a human-like manner is important for an autonomous vehicle to...
research
03/07/2023

Deep Occupancy-Predictive Representations for Autonomous Driving

Manually specifying features that capture the diversity in traffic envir...
research
10/01/2021

Multi-lane Cruising Using Hierarchical Planning and Reinforcement Learning

Competent multi-lane cruising requires using lane changes and within-lan...
research
04/14/2019

Online Sampling in the Parameter Space of a Neural Network for GPU-accelerated Motion Planning of Autonomous Vehicles

This paper proposes online sampling in the parameter space of a neural n...

Please sign up or login with your details

Forgot password? Click here to reset