Sampling-Based Verification of CTMCs with Uncertain Rates

05/17/2022
by   Thom S. Badings, et al.
0

We employ uncertain parametric CTMCs with parametric transition rates and a prior on the parameter values. The prior encodes uncertainty about the actual transition rates, while the parameters allow dependencies between transition rates. Sampling the parameter values from the prior distribution then yields a standard CTMC, for which we may compute relevant reachability probabilities. We provide a principled solution, based on a technique called scenario-optimization, to the following problem: From a finite set of parameter samples and a user-specified confidence level, compute prediction regions on the reachability probabilities. The prediction regions should (with high probability) contain the reachability probabilities of a CTMC induced by any additional sample. To boost the scalability of the approach, we employ standard abstraction techniques and adapt our methodology to support approximate reachability probabilities. Experiments with various well-known benchmarks show the applicability of the approach.

READ FULL TEXT
research
04/02/2019

On the Complexity of Reachability in Parametric Markov Decision Processes

This paper studies parametric Markov decision processes (pMDPs), an exte...
research
12/24/2019

Scenario-Based Verification of Uncertain MDPs

We consider Markov decision processes (MDPs) in which the transition pro...
research
12/24/2021

Scenario-Based Verification of Uncertain Parametric MDPs

We consider parametric Markov decision processes (pMDPs) that are augmen...
research
06/13/2018

Parameter-Independent Strategies for pMDPs via POMDPs

Markov Decision Processes (MDPs) are a popular class of models suitable ...
research
10/12/2022

Probabilities Are Not Enough: Formal Controller Synthesis for Stochastic Dynamical Models with Epistemic Uncertainty

Capturing uncertainty in models of complex dynamical systems is crucial ...
research
04/13/2018

Sound Value Iteration

Computing reachability probabilities is at the heart of probabilistic mo...
research
06/22/2022

Misinformation Mitigation under Differential Propagation Rates and Temporal Penalties

We propose an information propagation model that captures important temp...

Please sign up or login with your details

Forgot password? Click here to reset