Graph Planning with Expected Finite Horizon

02/10/2018
by   Krishnendu Chatterjee, et al.
0

Graph planning gives rise to fundamental algorithmic questions such as shortest path, traveling salesman problem, etc. A classical problem in discrete planning is to consider a weighted graph and construct a path that maximizes the sum of weights for a given time horizon T. However, in many scenarios, the time horizon is not fixed, but the stopping time is chosen according to some distribution such that the expected stopping time is T. If the stopping time distribution is not known, then to ensure robustness, the distribution is chosen by an adversary, to represent the worst-case scenario. A stationary plan for every vertex always chooses the same outgoing edge. For fixed horizon or fixed stopping-time distribution, stationary plans are not sufficient for optimality. Quite surprisingly we show that when an adversary chooses the stopping-time distribution with expected stopping time T, then stationary plans are sufficient. While computing optimal stationary plans for fixed horizon is NP-complete, we show that computing optimal stationary plans under adversarial stopping-time distribution can be achieved in polynomial time. Consequently, our polynomial-time algorithm for adversarial stopping time also computes an optimal plan among all possible plans.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/10/2022

A Fully Polynomial Time Approximation Scheme for Fixed-Horizon Constrained Stochastic Shortest Path Problem under Local Transitions

The fixed-horizon constrained stochastic shortest path problem (C-SSP) i...
research
11/12/2019

On optimal ordering in the optimal stopping problem

In the classical optimal stopping problem, a player is given a sequence ...
research
04/15/2021

Stochastic Processes with Expected Stopping Time

Markov chains are the de facto finite-state model for stochastic dynamic...
research
02/06/2021

Scheduling Plans of Tasks

We present a heuristic algorithm for solving the problem of scheduling p...
research
02/26/2019

Optimal Stopping of a Brownian Bridge with an Uncertain Pinning Time

We consider the problem of optimally stopping a Brownian bridge with an ...
research
05/27/2011

Computational Aspects of Reordering Plans

This article studies the problem of modifying the action ordering of a p...
research
02/26/2021

Sparse approximation in learning via neural ODEs

We consider the continuous-time, neural ordinary differential equation (...

Please sign up or login with your details

Forgot password? Click here to reset