Mind the Uncertainty: Risk-Aware and Actively Exploring Model-Based Reinforcement Learning

09/11/2023
by   Marin Vlastelica, et al.
0

We introduce a simple but effective method for managing risk in model-based reinforcement learning with trajectory sampling that involves probabilistic safety constraints and balancing of optimism in the face of epistemic uncertainty and pessimism in the face of aleatoric uncertainty of an ensemble of stochastic neural networks.Various experiments indicate that the separation of uncertainties is essential to performing well with data-driven MPC approaches in uncertain and safety-critical control environments.

READ FULL TEXT

page 2

page 7

research
04/16/2020

Reinforcement Learning for Safety-Critical Control under Model Uncertainty, using Control Lyapunov Functions and Control Barrier Functions

In this paper, the issue of model uncertainty in safety-critical control...
research
02/05/2020

Deep Learning Tubes for Tube MPC

Learning-based control aims to construct models of a system to use for p...
research
09/18/2021

Risk-averse autonomous systems: A brief history and recent developments from the perspective of optimal control

We offer a historical overview of methodologies for quantifying the noti...
research
10/06/2020

Real-time Uncertainty Decomposition for Online Learning Control

Safety-critical decisions based on machine learning models require a cle...
research
10/10/2017

Incorporating Epistemic Uncertainty into the Safety Assurance of Socio-Technical Systems

In system development, epistemic uncertainty is an ever-present possibil...
research
07/08/2019

Variational Inference MPC for Bayesian Model-based Reinforcement Learning

In recent studies on model-based reinforcement learning (MBRL), incorpor...
research
10/16/2020

Risk-Aware Decision Making in Service Robots to Minimize Risk of Patient Falls in Hospitals

Planning under uncertainty is a crucial capability for autonomous system...

Please sign up or login with your details

Forgot password? Click here to reset