Are Parametric Markov Chains Monotonic?

07/19/2019
by   Jip Spel, et al.
0

This paper presents a simple algorithm to check whether reachability probabilities in parametric Markov chains are monotonic in (some of) the parameters. The idea is to construct - only using the graph structure of the Markov chain and local transition probabilities - a pre-order on the states. Our algorithm cheaply checks a sufficient condition for monotonicity. Experiments show that monotonicity in several benchmarks is automatically detected, and monotonicity can speed up parameter synthesis up to orders of magnitude faster than a symbolic baseline.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/07/2017

Parametric Markov Chains: PCTL Complexity and Fraction-free Gaussian Elimination

Parametric Markov chains have been introduced as a model for families of...
research
04/02/2020

Robust Parametric Inference for Finite Markov Chains

We consider the problem of statistical inference in a parametric finite ...
research
03/16/2019

Parameter Synthesis for Markov Models

Markov chain analysis is a key technique in reliability engineering. A p...
research
05/29/2021

Fine-Tuning the Odds in Bayesian Networks

This paper proposes various new analysis techniques for Bayes networks i...
research
04/17/2023

Scenario Approach for Parametric Markov Models

In this paper, we propose an approximating framework for analyzing param...
research
02/23/2023

Fast Computation of Branching Process Transition Probabilities via ADMM

Branching processes are a class of continuous-time Markov chains (CTMCs)...
research
06/20/2017

Mean-Payoff Optimization in Continuous-Time Markov Chains with Parametric Alarms

Continuous-time Markov chains with alarms (ACTMCs) allow for alarm event...

Please sign up or login with your details

Forgot password? Click here to reset