Scenario Approach for Parametric Markov Models

04/17/2023
by   Ying Liu, et al.
0

In this paper, we propose an approximating framework for analyzing parametric Markov models. Instead of computing complex rational functions encoding the reachability probability and the reward values of the parametric model, we exploit the scenario approach to synthesize a relatively simple polynomial approximation. The approximation is probably approximately correct (PAC), meaning that with high confidence, the approximating function is close to the actual function with an allowable error. With the PAC approximations, one can check properties of the parametric Markov models. We show that the scenario approach can also be used to check PRCTL properties directly, without synthesizing the polynomial at first hand. We have implemented our algorithm in a prototype tool and conducted thorough experiments. The experimental results demonstrate that our tool is able to compute polynomials for more benchmarks than state of the art tools such as PRISM and Storm, confirming the efficacy of our PAC-based synthesis.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/05/2020

PAC Reinforcement Learning Algorithm for General-Sum Markov Games

This paper presents a theoretical framework for probably approximately c...
research
01/25/2021

Probabilistic Robustness Analysis for DNNs based on PAC Learning

This paper proposes a black box based approach for analysing deep neural...
research
07/19/2019

Are Parametric Markov Chains Monotonic?

This paper presents a simple algorithm to check whether reachability pro...
research
03/10/2022

Data-driven Abstractions with Probabilistic Guarantees for Linear PETC Systems

We employ the scenario approach to compute probably approximately correc...
research
05/10/2019

PAC Statistical Model Checking for Markov Decision Processes and Stochastic Games

Statistical model checking (SMC) is a technique for analysis of probabil...
research
02/02/2021

Fast Parametric Model Checking through Model Fragmentation

Parametric model checking (PMC) computes algebraic formulae that express...
research
12/18/2021

Data-Driven Reachability analysis and Support set Estimation with Christoffel Functions

We present algorithms for estimating the forward reachable set of a dyna...

Please sign up or login with your details

Forgot password? Click here to reset