DeepAI
Log In Sign Up

Analysis of Markov Jump Processes under Terminal Constraints

10/20/2020
by   Michael Backenköhler, et al.
0

Many probabilistic inference problems such as stochastic filtering or the computation of rare event probabilities require model analysis under initial and terminal constraints. We propose a solution to this bridging problem for the widely used class of population-structured Markov jump processes. The method is based on a state-space lumping scheme that aggregates states in a grid structure. The resulting approximate bridging distribution is used to iteratively refine relevant and truncate irrelevant parts of the state-space. This way the algorithm learns a well-justified finite-state projection yielding guaranteed lower bounds for the system behavior under endpoint constraints. We demonstrate the method's applicability to a wide range of problems such as Bayesian inference and the analysis of rare events.

READ FULL TEXT
05/03/2021

Abstraction-Guided Truncations for Stationary Distributions of Markov Population Models

To understand the long-run behavior of Markov population models, the com...
08/08/2022

An integer grid bridge sampler for the Bayesian inference of incomplete birth-death records

A one-to-one correspondence is established between the bridge path space...
11/08/2017

Recency-weighted Markovian inference

We describe a Markov latent state space (MLSS) model, where the latent s...
05/20/2022

Adaptive Bayesian Inference of Markov Transition Rates

Optimal designs minimize the number of experimental runs (samples) neede...
07/20/2017

Sequential Lifted Bayesian Filtering in Multiset Rewriting Systems

Bayesian Filtering for plan and activity recognition is challenging for ...
03/29/2020

Special Function Methods for Bursty Models of Transcription

We explore a Markov model used in the analysis of gene expression, invol...