Combining Planning and Deep Reinforcement Learning in Tactical Decision Making for Autonomous Driving

05/06/2019
by   Carl-Johan Hoel, et al.
0

Tactical decision making for autonomous driving is challenging due to the diversity of environments, the uncertainty in the sensor information, and the complex interaction with other road users. This paper introduces a general framework for tactical decision making, which combines the concepts of planning and learning, in the form of Monte Carlo tree search and deep reinforcement learning. The method is based on the AlphaGo Zero algorithm, which is extended to a domain with a continuous state space where self-play cannot be used. The framework is applied to two different highway driving cases in a simulated environment and it is shown to perform better than a commonly used baseline method. The strength of combining planning and learning is also illustrated by a comparison to using the Monte Carlo tree search or the neural network policy separately.

READ FULL TEXT

page 1

page 5

page 11

page 12

research
09/15/2023

MBAPPE: MCTS-Built-Around Prediction for Planning Explicitly

We present MBAPPE, a novel approach to motion planning for autonomous dr...
research
02/25/2022

Decision Making in Non-Stationary Environments with Policy-Augmented Monte Carlo Tree Search

Decision-making under uncertainty (DMU) is present in many important pro...
research
05/23/2017

Thinking Fast and Slow with Deep Learning and Tree Search

Sequential decision making problems, such as structured prediction, robo...
research
11/10/2021

Spatially and Seamlessly Hierarchical Reinforcement Learning for State Space and Policy space in Autonomous Driving

Despite advances in hierarchical reinforcement learning, its application...
research
12/04/2018

Risk-averse Behavior Planning for Autonomous Driving under Uncertainty

Autonomous vehicles have to navigate the surrounding environment with pa...
research
10/30/2020

Interleaving Fast and Slow Decision Making

The "Thinking, Fast and Slow" paradigm of Kahneman proposes that we use ...
research
03/23/2020

Using Deep Reinforcement Learning Methods for Autonomous Vessels in 2D Environments

Unmanned Surface Vehicles technology (USVs) is an exciting topic that es...

Please sign up or login with your details

Forgot password? Click here to reset