Risk-averse autonomous systems: A brief history and recent developments from the perspective of optimal control

09/18/2021
by   Yuheng Wang, et al.
0

We offer a historical overview of methodologies for quantifying the notion of risk and optimizing risk-aware autonomous systems, with emphasis on risk-averse settings in which safety may be critical. We categorize and present state-of-the-art approaches, and we describe connections between such approaches and ideas from the fields of decision theory, operations research, reinforcement learning, and stochastic control. The first part of the review focuses on model-based risk-averse methods. The second part discusses methods that blend model-based and model-free techniques for the purpose of designing policies with improved adaptive capabilities. We conclude by highlighting areas for future research.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/11/2022

Bridging Model-based Safety and Model-free Reinforcement Learning through System Identification of Low Dimensional Linear Models

Bridging model-based safety and model-free reinforcement learning (RL) f...
research
09/11/2023

Mind the Uncertainty: Risk-Aware and Actively Exploring Model-Based Reinforcement Learning

We introduce a simple but effective method for managing risk in model-ba...
research
07/15/2021

Optimal sports betting strategies in practice: an experimental review

We investigate the most popular approaches to the problem of sports bett...
research
04/23/2019

Risk Structures: Towards Engineering Risk-aware Autonomous Systems

Inspired by widely-used techniques of causal modelling in risk, failure,...
research
05/05/2023

A Survey on Offline Model-Based Reinforcement Learning

Model-based approaches are becoming increasingly popular in the field of...
research
10/16/2020

Risk-Aware Decision Making in Service Robots to Minimize Risk of Patient Falls in Hospitals

Planning under uncertainty is a crucial capability for autonomous system...
research
09/11/2023

The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systems

Recent years have seen significant progress in the realm of robot autono...

Please sign up or login with your details

Forgot password? Click here to reset