UMBRELLA: Uncertainty-Aware Model-Based Offline Reinforcement Learning Leveraging Planning

11/22/2021
by   Christopher Diehl, et al.
0

Offline reinforcement learning (RL) provides a framework for learning decision-making from offline data and therefore constitutes a promising approach for real-world applications as automated driving. Self-driving vehicles (SDV) learn a policy, which potentially even outperforms the behavior in the sub-optimal data set. Especially in safety-critical applications as automated driving, explainability and transferability are key to success. This motivates the use of model-based offline RL approaches, which leverage planning. However, current state-of-the-art methods often neglect the influence of aleatoric uncertainty arising from the stochastic behavior of multi-agent systems. This work proposes a novel approach for Uncertainty-aware Model-Based Offline REinforcement Learning Leveraging plAnning (UMBRELLA), which solves the prediction, planning, and control problem of the SDV jointly in an interpretable learning-based fashion. A trained action-conditioned stochastic dynamics model captures distinctively different future evolutions of the traffic scene. The analysis provides empirical evidence for the effectiveness of our approach in challenging automated driving simulations and based on a real-world public dataset.

READ FULL TEXT

page 6

page 17

research
05/16/2021

Model-Based Offline Planning with Trajectory Pruning

Offline reinforcement learning (RL) enables learning policies using pre-...
research
03/18/2021

Integrated Decision and Control: Towards Interpretable and Efficient Driving Intelligence

Decision and control are two of the core functionalities of high-level a...
research
04/17/2023

Integration of Reinforcement Learning Based Behavior Planning With Sampling Based Motion Planning for Automated Driving

Reinforcement learning has received high research interest for developin...
research
11/30/2022

One Risk to Rule Them All: A Risk-Sensitive Perspective on Model-Based Offline Reinforcement Learning

Offline reinforcement learning (RL) is suitable for safety-critical doma...
research
07/21/2022

Addressing Optimism Bias in Sequence Modeling for Reinforcement Learning

Impressive results in natural language processing (NLP) based on the Tra...
research
11/19/2022

Prediction-aware and Reinforcement Learning based Altruistic Cooperative Driving

Autonomous vehicle (AV) navigation in the presence of Human-driven vehic...
research
02/23/2022

Cooperative Behavioral Planning for Automated Driving using Graph Neural Networks

Urban intersections are prone to delays and inefficiencies due to static...

Please sign up or login with your details

Forgot password? Click here to reset