Robust Model Checking with Imprecise Markov Reward Models

03/08/2021
by   Alberto Termine, et al.
0

In recent years probabilistic model checking has become an important area of research because of the diffusion of computational systems of stochastic nature. Despite its great success, standard probabilistic model checking suffers the limitation of requiring a sharp specification of the probabilities governing the model behaviour. The theory of imprecise probabilities offers a natural approach to overcome such limitation by a sensitivity analysis with respect to the values of these parameters. However, only extensions based on discrete-time imprecise Markov chains have been considered so far for such a robust approach to model checking. We present a further extension based on imprecise Markov reward models. In particular, we derive efficient algorithms to compute lower and upper bounds of the expected cumulative reward and probabilistic bounded rewards based on existing results for imprecise Markov chains. These ideas are tested on a real case study involving the spend-down costs of geriatric medicine departments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/21/2022

Model-Checking Branching-Time Properties of Stateless Probabilistic Pushdown Systems and Its Quantum Extension

In this work, we first resolve a question in the probabilistic verificat...
research
08/22/2021

Algorithms for reachability problems on stochastic Markov reward models

Probabilistic model-checking is a field which seeks to automate the form...
research
05/15/2018

Accelerated Model Checking of Parametric Markov Chains

Parametric Markov chains occur quite naturally in various applications: ...
research
02/15/2019

Shepherding Hordes of Markov Chains

This paper considers large families of Markov chains (MCs) that are defi...
research
05/26/2021

Model Checking Finite-Horizon Markov Chains with Probabilistic Inference

We revisit the symbolic verification of Markov chains with respect to fi...
research
11/04/2019

Optimistic Optimization for Statistical Model Checking with Regret Bounds

We explore application of multi-armed bandit algorithms to statistical m...
research
05/01/2023

Efficient Sensitivity Analysis for Parametric Robust Markov Chains

We provide a novel method for sensitivity analysis of parametric robust ...

Please sign up or login with your details

Forgot password? Click here to reset