DeepAI AI Chat
Log In Sign Up

Data analysis recipes: Using Markov Chain Monte Carlo

10/17/2017
by   David W. Hogg, et al.
0

Markov Chain Monte Carlo (MCMC) methods for sampling probability density functions (combined with abundant computational resources) have transformed the sciences, especially in performing probabilistic inferences, or fitting models to data. In this primarily pedagogical contribution, we give a brief overview of the most basic MCMC method and some practical advice for the use of MCMC in real inference problems. We give advice on method choice, tuning for performance, methods for initialization, tests of convergence, troubleshooting, and use of the chain output to produce or report parameter estimates with associated uncertainties. We argue that autocorrelation time is the most important test for convergence, as it directly connects to the uncertainty on the sampling estimate of any quantity of interest. We emphasize that sampling is a method for doing integrals; this guides our thinking about how MCMC output is best used.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/04/2020

tfp.mcmc: Modern Markov Chain Monte Carlo Tools Built for Modern Hardware

Markov chain Monte Carlo (MCMC) is widely regarded as one of the most im...
07/26/2019

Analyzing MCMC Output

Markov chain Monte Carlo (MCMC) is a sampling-based method for estimatin...
11/29/2020

Accelerating MCMC algorithms through Bayesian Deep Networks

Markov Chain Monte Carlo (MCMC) algorithms are commonly used for their v...
10/28/2012

Parallel MCMC with Generalized Elliptical Slice Sampling

Probabilistic models are conceptually powerful tools for finding structu...
05/10/2018

Unbiased and Consistent Nested Sampling via Sequential Monte Carlo

We introduce a new class of sequential Monte Carlo methods called Nested...
08/07/2020

Parallelizing MCMC Sampling via Space Partitioning

Efficient sampling of many-dimensional and multimodal density functions ...
03/21/2022

DBSOP: An Efficient Heuristic for Speedy MCMC Sampling on Polytopes

Markov Chain Monte Carlo (MCMC) techniques have long been studied in com...