Foundations of probability-raising causality in Markov decision processes

09/07/2022
by   Christel Baier, et al.
0

This work introduces a novel cause-effect relation in Markov decision processes using the probability-raising principle. Initially, sets of states as causes and effects are considered, which is subsequently extended to regular path properties as effects and then as causes. The paper lays the mathematical foundations and analyzes the algorithmic properties of these cause-effect relations. This includes algorithms for checking cause conditions given an effect and deciding the existence of probability-raising causes. As the definition allows for sub-optimal coverage properties, quality measures for causes inspired by concepts of statistical analysis are studied. These include recall, coverage ratio and f-score. The computational complexity for finding optimal causes with respect to these measures is analyzed.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/21/2022

On probability-raising causality in Markov decision processes

The purpose of this paper is to introduce a notion of causality in Marko...
research
04/27/2022

Bounds for Synchronizing Markov Decision Processes

We consider Markov decision processes with synchronizing objectives, whi...
research
11/14/2019

Analysis of the fiber laydown quality in spunbond processes with simulation experiments evaluated by blocked neural networks

We present a simulation framework for spunbond processes and use a desig...
research
04/28/2021

Probabilistic causes in Markov chains

The paper studies a probabilistic notion of causes in Markov chains that...
research
10/22/2017

The Complexity of Graph-Based Reductions for Reachability in Markov Decision Processes

We study the never-worse relation (NWR) for Markov decision processes wi...
research
05/09/2012

The Temporal Logic of Causal Structures

Computational analysis of time-course data with an underlying causal str...
research
03/17/2023

On the Effect of Instrumentation on Test Flakiness

Test flakiness is a problem that affects testing and processes that rely...

Please sign up or login with your details

Forgot password? Click here to reset