Risk-Averse Stochastic Shortest Path Planning

03/26/2021
by   Mohamadreza Ahmadi, et al.
0

We consider the stochastic shortest path planning problem in MDPs, i.e., the problem of designing policies that ensure reaching a goal state from a given initial state with minimum accrued cost. In order to account for rare but important realizations of the system, we consider a nested dynamic coherent risk total cost functional rather than the conventional risk-neutral total expected cost. Under some assumptions, we show that optimal, stationary, Markovian policies exist and can be found via a special Bellman's equation. We propose a computational technique based on difference convex programs (DCPs) to find the associated value functions and therefore the risk-averse policies. A rover navigation MDP is used to illustrate the proposed methodology with conditional-value-at-risk (CVaR) and entropic-value-at-risk (EVaR) coherent risk measures.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/25/2021

Lexicographic Optimisation of Conditional Value at Risk and Expected Value for Risk-Averse Planning in MDPs

Planning in Markov decision processes (MDPs) typically optimises the exp...
research
03/03/2022

Risk-aware Stochastic Shortest Path

We treat the problem of risk-aware control for stochastic shortest path ...
research
05/11/2022

Hierarchical Constrained Stochastic Shortest Path Planning via Cost Budget Allocation

Stochastic sequential decision making often requires hierarchical struct...
research
03/01/2023

Forward-PECVaR Algorithm: Exact Evaluation for CVaR SSPs

The Stochastic Shortest Path (SSP) problem models probabilistic sequenti...
research
02/25/2023

Dual Formulation for Chance Constrained Stochastic Shortest Path with Application to Autonomous Vehicle Behavior Planning

Autonomous vehicles face the problem of optimizing the expected performa...
research
10/16/2012

A Theory of Goal-Oriented MDPs with Dead Ends

Stochastic Shortest Path (SSP) MDPs is a problem class widely studied in...
research
09/27/2019

Risk-Averse Planning Under Uncertainty

We consider the problem of designing policies for partially observable M...

Please sign up or login with your details

Forgot password? Click here to reset