Conditioning continuous-time Markov processes by guiding

11/22/2021
by   Marc Corstanje, et al.
0

A continuous-time Markov process X can be conditioned to be in a given state at a fixed time T > 0 using Doob's h-transform. This transform requires the typically intractable transition density of X. The effect of the h-transform can be described as introducing a guiding force on the process. Replacing this force with an approximation defines the wider class of guided processes. For certain approximations the law of a guided process approximates - and is equivalent to - the actual conditional distribution, with tractable likelihood-ratio. The main contribution of this paper is to prove that the principle of a guided process, introduced in Schauer et al. (2017) for stochastic differential equations, can be extended to a more general class of Markov processes. In particular we apply the guiding technique to jump processes in discrete state spaces. The Markov process perspective enables us to improve upon existing results for hypo-elliptic diffusions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/06/2022

Beyond time-homogeneity for continuous-time multistate Markov models

Multistate Markov models are a canonical parametric approach for data mo...
research
10/07/2020

Automatic Backward Filtering Forward Guiding for Markov processes and graphical models

We incorporate discrete and continuous time Markov processes as building...
research
10/03/2018

Simulation of elliptic and hypo-elliptic conditional diffusions

Suppose X is a multidimensional diffusion process. Assume that at time z...
research
12/18/2015

Expectation propagation for continuous time stochastic processes

We consider the inverse problem of reconstructing the posterior measure ...
research
05/31/2023

Neural Markov Jump Processes

Markov jump processes are continuous-time stochastic processes with a wi...
research
11/24/2021

Strong Invariance Principles for Ergodic Markov Processes

Strong invariance principles describe the error term of a Brownian appro...
research
08/17/2023

Closed-form approximations of moments and densities of continuous-time Markov models

This paper develops power series expansions of a general class of moment...

Please sign up or login with your details

Forgot password? Click here to reset