Estimating Monte Carlo variance from multiple Markov chains

07/08/2020
by   Kushagra Gupta, et al.
0

The ever-increasing power of the personal computer has led to easy parallel implementations of Markov chain Monte Carlo (MCMC). However, almost all work in estimating the variance of Monte Carlo averages, including the efficient batch means (BM) estimator, focuses on a single-chain MCMC run. We demonstrate that simply averaging covariance matrix estimators from multiple chains (average BM) can yield critical underestimates in small sample sizes, especially for slow mixing Markov chains. We propose a multivariate replicated batch means (RBM) estimator that utilizes information from parallel chains, thereby correcting for the underestimation. Under weak conditions on the mixing rate of the process, the RBM and ABM estimator are both strongly consistent and exhibit similar large-sample bias and variance. However, in small runs the RBM estimator can be dramatically superior. This is demonstrated through a variety of examples, including a two-variable Gibbs sampler for a bivariate Gaussian target distribution. Here, we obtain a closed-form expression for the asymptotic covariance matrix of the Monte Carlo estimator, a useful result for benchmarking in the future.

READ FULL TEXT
research
09/03/2020

Globally-centered autocovariances in MCMC

Autocovariances are a fundamental quantity of interest in Markov chain M...
research
07/26/2022

Efficient shape-constrained inference for the autocovariance sequence from a reversible Markov chain

In this paper, we study the problem of estimating the autocovariance seq...
research
11/03/2019

Estimating accuracy of the MCMC variance estimator: a central limit theorem for batch means estimators

The batch means estimator of the MCMC variance is a simple and effective...
research
08/13/2022

Finite Sample Complexity of Sequential Monte Carlo Estimators on Multimodal Target Distributions

We prove finite sample complexities for sequential Monte Carlo (SMC) alg...
research
02/18/2019

Mean and variance of first passage time in Markov chains with unknown parameters

There are known expressions to calculate the moments of the first passag...
research
10/11/2018

Efficient estimation of autocorrelation spectra

The performance of Markov chain Monte Carlo calculations is determined b...
research
10/25/2021

Nested R̂: Assessing Convergence for Markov chain Monte Carlo when using many short chains

When using Markov chain Monte Carlo (MCMC) algorithms, we can increase t...

Please sign up or login with your details

Forgot password? Click here to reset