Mean and variance of first passage time in Markov chains with unknown parameters

02/18/2019
by   Carlos Hernandez-Suarez, et al.
0

There are known expressions to calculate the moments of the first passage time in Markov chains. Nevertheless, it is commonly forgotten that in most applications the parameters of the Markov chain are constructed using estimates based upon empirical data and in those cases the data sample size should play an important role in estimating the variance. Here we provide a Monte Carlo approach to estimate the first two moments of the passage time in this situation. We illustrate this method with an example using data from the biological field.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/26/2022

Efficient shape-constrained inference for the autocovariance sequence from a reversible Markov chain

In this paper, we study the problem of estimating the autocovariance seq...
research
07/08/2020

Estimating Monte Carlo variance from multiple Markov chains

The ever-increasing power of the personal computer has led to easy paral...
research
04/14/2016

Consistently Estimating Markov Chains with Noisy Aggregate Data

We address the problem of estimating the parameters of a time-homogeneou...
research
09/01/2020

Variance Reduction with Array-RQMC for Tau-Leaping Simulation of Stochastic Biological and Chemical Reaction Networks

We explore the use of Array-RQMC, a randomized quasi-Monte Carlo method ...
research
08/30/2020

Improving graduation rate estimates using regularly updated Markov chains

American universities use a rolling six-year graduation rate (SYGR) to c...
research
11/22/2021

Combining chains of Bayesian models with Markov melding

A challenge for practitioners of Bayesian inference is specifying a mode...
research
06/04/2021

Estimating parking occupancy using smart meter transaction data

The excessive search for parking, known as cruising, generates pollution...

Please sign up or login with your details

Forgot password? Click here to reset