Unbiased time-average estimators for Markov chains

09/20/2022
by   Nabil Kahale, et al.
0

We consider a time-average estimator f_k of a functional of a Markov chain. Under a coupling assumption, we show that the expectation of f_k has a limit μ as the number of time-steps goes to infinity. We describe a modification of f_k that yields an unbiased estimator f̂_k of μ. It is shown that f̂_k is square-integrable and has finite expected running time. Under certain conditions, f̂_k can be built without any precomputations, and is asymptotically at least as efficient as f_k, up to a multiplicative constant arbitrarily close to 1. Our approach provides an unbiased estimator for the bias of f_k. We study applications to volatility forecasting, queues, and the simulation of high-dimensional Gaussian vectors. Our numerical experiments are consistent with our theoretical findings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/24/2017

Randomized Dimension Reduction for Monte Carlo Simulations

We present a new unbiased algorithm that estimates the expected value of...
research
09/01/2017

Unbiased Hamiltonian Monte Carlo with couplings

We propose a coupling approach to parallelize Hamiltonian Monte Carlo es...
research
08/11/2017

Unbiased Markov chain Monte Carlo with couplings

Markov chain Monte Carlo (MCMC) methods provide consistent approximation...
research
02/05/2019

Unbiased Smoothing using Particle Independent Metropolis-Hastings

We consider the approximation of expectations with respect to the distri...
research
06/14/2022

Unbiased Estimation using the Underdamped Langevin Dynamics

In this work we consider the unbiased estimation of expectations w.r.t. ...
research
05/27/2021

Unbiased estimation of equilibrium, rates, and committors from Markov state model analysis

Markov state models (MSMs) have been broadly adopted for analyzing molec...
research
08/28/2020

Double Happiness: Enhancing the Coupled Gains of L-lag Coupling via Control Variates

The recently proposed L-lag coupling for unbiased MCMC <cit.> calls for ...

Please sign up or login with your details

Forgot password? Click here to reset