Abstraction-Guided Truncations for Stationary Distributions of Markov Population Models

05/03/2021
by   Michael Backenköhler, et al.
0

To understand the long-run behavior of Markov population models, the computation of the stationary distribution is often a crucial part. We propose a truncation-based approximation that employs a state-space lumping scheme, aggregating states in a grid structure. The resulting approximate stationary distribution is used to iteratively refine relevant and truncate irrelevant parts of the state-space. This way, the algorithm learns a well-justified finite-state projection tailored to the stationary behavior. We demonstrate the method's applicability to a wide range of non-linear problems with complex stationary behaviors.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/20/2020

Analysis of Markov Jump Processes under Terminal Constraints

Many probabilistic inference problems such as stochastic filtering or th...
research
06/23/2022

On Convergence of a Truncation Scheme for Approximating Stationary Distributions of Continuous State Space Markov Chains and Processes

In the analysis of Markov chains and processes, it is sometimes convenie...
research
08/30/2023

A Classification of Observation-Driven State-Space Count Models for Panel Data

State-space models are widely used in many applications. In the domain o...
research
03/18/2021

Lossless compression with state space models using bits back coding

We generalize the 'bits back with ANS' method to time-series models with...
research
03/30/2023

Gaussian-Based Parametric Bijections For Automatic Projection Filters

The automatic projection filter is a recently developed numerical method...
research
01/18/2014

Proximity-Based Non-uniform Abstractions for Approximate Planning

In a deterministic world, a planning agent can be certain of the consequ...
research
06/25/2014

Learning the ergodic decomposition

A Bayesian agent learns about the structure of a stationary process from...

Please sign up or login with your details

Forgot password? Click here to reset