A Fully Polynomial Time Approximation Scheme for Fixed-Horizon Constrained Stochastic Shortest Path Problem under Local Transitions

04/10/2022
by   Majid Khonji, et al.
0

The fixed-horizon constrained stochastic shortest path problem (C-SSP) is a formalism for planning in stochastic environments under certain operating constraints. Chance-Constrained SSP (CC-SSP) is a variant that allows bounding the probability of constraint violation, which is desired in many safety-critical applications. This work considers an important variant of (C)C-SSP under local transition, capturing a broad class of SSP problems where state reachability exhibit a certain locality. Only a constant number of states can share some subsequent states. (C)C-SSP under local transition is NP-Hard even for a planning horizon of two. In this work, we propose a fully polynomial-time approximation scheme for (C)C-SSP that computes (near) optimal deterministic policies. Such an algorithm is the best approximation algorithm attainable in theory

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/25/2023

Dual Formulation for Chance Constrained Stochastic Shortest Path with Application to Autonomous Vehicle Behavior Planning

Autonomous vehicles face the problem of optimizing the expected performa...
research
02/10/2018

Graph Planning with Expected Finite Horizon

Graph planning gives rise to fundamental algorithmic questions such as s...
research
04/28/2023

Hardness of Finding Combinatorial Shortest Paths on Graph Associahedra

We prove that the computation of a combinatorial shortest path between t...
research
05/11/2022

Hierarchical Constrained Stochastic Shortest Path Planning via Cost Budget Allocation

Stochastic sequential decision making often requires hierarchical struct...
research
02/07/2022

Policy Optimization for Stochastic Shortest Path

Policy optimization is among the most popular and successful reinforceme...
research
02/24/2016

Stochastic Shortest Path with Energy Constraints in POMDPs

We consider partially observable Markov decision processes (POMDPs) with...
research
04/21/2022

The variance-penalized stochastic shortest path problem

The stochastic shortest path problem (SSPP) asks to resolve the non-dete...

Please sign up or login with your details

Forgot password? Click here to reset