Property-driven State-Space Coarsening for Continuous Time Markov Chains

06/03/2016
by   Michalis Michaelides, et al.
0

Dynamical systems with large state-spaces are often expensive to thoroughly explore experimentally. Coarse-graining methods aim to define simpler systems which are more amenable to analysis and exploration; most current methods, however, focus on a priori state aggregation based on similarities in transition rates, which is not necessarily reflected in similar behaviours at the level of trajectories. We propose a way to coarsen the state-space of a system which optimally preserves the satisfaction of a set of logical specifications about the system's trajectories. Our approach is based on Gaussian Process emulation and Multi-Dimensional Scaling, a dimensionality reduction technique which optimally preserves distances in non-Euclidean spaces. We show how to obtain low-dimensional visualisations of the system's state-space from the perspective of properties' satisfaction, and how to define macro-states which behave coherently with respect to the specifications. Our approach is illustrated on a non-trivial running example, showing promising performance and high computational efficiency.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/04/2020

Localized active learning of Gaussian process state space models

The performance of learning-based control techniques crucially depends o...
research
09/27/2019

Identifying Low-Dimensional Structures in Markov Chains: A Nonnegative Matrix Factorization Approach

A variety of queries about stochastic systems boil down to study of Mark...
research
02/22/2023

nSimplex Zen: A Novel Dimensionality Reduction for Euclidean and Hilbert Spaces

Dimensionality reduction techniques map values from a high dimensional s...
research
01/31/2019

Geometric fluid approximation for general continuous-time Markov chains

Fluid approximations have seen great success in approximating the macro-...
research
10/23/2021

Stochastic facilitation in heteroclinic communication channels

Biological neural systems encode and transmit information as patterns of...
research
11/10/2017

Model Checking Markov Population Models by Stochastic Approximations

Many complex systems can be described by population models, in which a p...
research
03/30/2023

Data-driven abstractions via adaptive refinements and a Kantorovich metric [extended version]

We introduce an adaptive refinement procedure for smart, and scalable ab...

Please sign up or login with your details

Forgot password? Click here to reset