Model Checking Markov Population Models by Stochastic Approximations

11/10/2017
by   Luca Bortolussi, et al.
0

Many complex systems can be described by population models, in which a pool of agents interacts and produces complex collective behaviours. We consider the problem of verifying formal properties of the underlying mathematical representation of these models, which is a Continuous Time Markov Chain, often with a huge state space. To circumvent the state space explosion, we rely on stochastic approximation techniques, which replace the large model by a simpler one, guaranteed to be probabilistically consistent. We show how to efficiently and accurately verify properties of random individual agents, specified by Continuous Stochastic Logic extended with Timed Automata (CSL-TA), and how to lift these specifications to the collective level, approximating the number of agents satisfying them using second or higher order stochastic approximation techniques.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/23/2018

Central Limit Model Checking

We consider probabilistic model checking for continuous-time Markov chai...
research
11/06/2017

Probabilistic Model Checking for Continuous Time Markov Chains via Sequential Bayesian Inference

Probabilistic model checking for systems with large or unbounded state s...
research
12/01/2017

Verifying Probabilistic Timed Automata Against Omega-Regular Dense-Time Properties

Probabilistic timed automata (PTAs) are timed automata (TAs) extended wi...
research
11/24/2016

Multiscale Inverse Reinforcement Learning using Diffusion Wavelets

This work presents a multiscale framework to solve an inverse reinforcem...
research
01/31/2019

Geometric fluid approximation for general continuous-time Markov chains

Fluid approximations have seen great success in approximating the macro-...
research
06/24/2021

Abstraction of Markov Population Dynamics via Generative Adversarial Nets

Markov Population Models are a widespread formalism used to model the dy...
research
06/03/2016

Property-driven State-Space Coarsening for Continuous Time Markov Chains

Dynamical systems with large state-spaces are often expensive to thoroug...

Please sign up or login with your details

Forgot password? Click here to reset