Expected Window Mean-Payoff

12/21/2018
by   Benjamin Bordais, et al.
0

In the window mean-payoff objective, given an infinite path, instead of considering a long run average, we consider the minimum payoff that can be ensured at every position of the path over a finite window that slides over the entire path. Chatterjee et al. studied the problem to decide if in a two-player game, Player 1 has a strategy to ensure a window mean-payoff of at least 0. In this work, we consider a function that given a path returns the supremum value of the window mean-payoff that can be ensured over the path and we show how to compute its expected value in Markov chains and Markov decision processes. We consider two variants of the function: Fixed window mean-payoff in which a fixed window length l_max is provided; and Bounded window mean-payoff in which we compute the maximum possible value of the window mean-payoff over all possible window lengths. Further, for both variants, we consider (i) a direct version of the problem where for each path, the payoff that can be ensured from its very beginning and (ii) a non-direct version that is the prefix independent counterpart of the direct version of the problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/23/2023

Stochastic Window Mean-payoff Games

Stochastic two-player games model systems with an environment that is bo...
research
01/11/2019

Life is Random, Time is Not: Markov Decision Processes with Window Objectives

The window mechanism was introduced by Chatterjee et al. [1] to strength...
research
05/14/2021

Time Flies When Looking out of the Window: Timed Games with Window Parity Objectives

The window mechanism was introduced by Chatterjee et al. to reinforce me...
research
05/09/2022

Timed Games with Bounded Window Parity Objectives

The window mechanism, introduced by Chatterjee et al. for mean-payoff an...
research
08/09/2014

POMDPs under Probabilistic Semantics

We consider partially observable Markov decision processes (POMDPs) with...
research
02/08/2021

Throwing a Sofa Through the Window

We study several variants of the problem of moving a convex polytope K, ...
research
03/16/2007

Plot 94 in ambiance X-Window

<PLOT > is a collection of routines to draw surfaces, contours and so on...

Please sign up or login with your details

Forgot password? Click here to reset