Probabilistic Planning with Preferences over Temporal Goals

03/26/2021
by   Jie Fu, et al.
0

We present a formal language for specifying qualitative preferences over temporal goals and a preference-based planning method in stochastic systems. Using automata-theoretic modeling, the proposed specification allows us to express preferences over different sets of outcomes, where each outcome describes a set of temporal sequences of subgoals. We define the value of preference satisfaction given a stochastic process over possible outcomes and develop an algorithm for time-constrained probabilistic planning in labeled Markov decision processes where an agent aims to maximally satisfy its preference formula within a pre-defined finite time duration. We present experimental results using a stochastic gridworld example and discuss possible extensions of the proposed preference model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/25/2022

Opportunistic Qualitative Planning in Stochastic Systems with Preferences over Temporal Logic Objectives

Preferences play a key role in determining what goals/constraints to sat...
research
09/25/2022

Probabilistic Planning with Partially Ordered Preferences over Temporal Goals

In this paper, we study planning in stochastic systems, modeled as Marko...
research
04/23/2023

Probabilistic Planning with Prioritized Preferences over Temporal Logic Objectives

This paper studies temporal planning in probabilistic environments, mode...
research
09/28/2011

The Planning Spectrum - One, Two, Three, Infinity

Linear Temporal Logic (LTL) is widely used for defining conditions on th...
research
08/09/2021

Bob and Alice Go to a Bar: Reasoning About Future With Probabilistic Programs

Agent preferences should be specified stochastically rather than determi...
research
10/04/2022

Opportunistic Qualitative Planning in Stochastic Systems with Incomplete Preferences over Reachability Objectives

Preferences play a key role in determining what goals/constraints to sat...
research
05/15/2019

Specifying and Reasoning about Contextual Preferences in the Goal-oriented Requirements Modelling

Goal-oriented requirements variability modelling has established the und...

Please sign up or login with your details

Forgot password? Click here to reset