DeepAI
Log In Sign Up

Abstraction-Guided Truncations for Stationary Distributions of Markov Population Models

05/03/2021
by   Michael Backenköhler, et al.
0

To understand the long-run behavior of Markov population models, the computation of the stationary distribution is often a crucial part. We propose a truncation-based approximation that employs a state-space lumping scheme, aggregating states in a grid structure. The resulting approximate stationary distribution is used to iteratively refine relevant and truncate irrelevant parts of the state-space. This way, the algorithm learns a well-justified finite-state projection tailored to the stationary behavior. We demonstrate the method's applicability to a wide range of non-linear problems with complex stationary behaviors.

READ FULL TEXT

page 1

page 2

page 3

page 4

10/20/2020

Analysis of Markov Jump Processes under Terminal Constraints

Many probabilistic inference problems such as stochastic filtering or th...
03/18/2021

Lossless compression with state space models using bits back coding

We generalize the 'bits back with ANS' method to time-series models with...
11/08/2017

Recency-weighted Markovian inference

We describe a Markov latent state space (MLSS) model, where the latent s...
08/06/2020

Red Light Green Light Method for Solving Large Markov Chains

Discrete-time discrete-state finite Markov chains are versatile mathemat...
06/25/2014

Learning the ergodic decomposition

A Bayesian agent learns about the structure of a stationary process from...