Scan Order in Gibbs Sampling: Models in Which it Matters and Bounds on How Much

06/10/2016
by   Bryan He, et al.
0

Gibbs sampling is a Markov Chain Monte Carlo sampling technique that iteratively samples variables from their conditional distributions. There are two common scan orders for the variables: random scan and systematic scan. Due to the benefits of locality in hardware, systematic scan is commonly used, even though most statistical guarantees are only for random scan. While it has been conjectured that the mixing times of random scan and systematic scan do not differ by more than a logarithmic factor, we show by counterexample that this is not the case, and we prove that that the mixing times do not differ by more than a polynomial factor under mild conditions. To prove these relative bounds, we introduce a method of augmenting the state space to study systematic scan using conductance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/18/2017

Improving Gibbs Sampler Scan Quality with DoGS

The pairwise influence matrix of Dobrushin has long been used as an anal...
research
04/04/2023

Solidarity of Gibbs Samplers: the spectral gap

Gibbs samplers are preeminent Markov chain Monte Carlo algorithms used i...
research
06/26/2020

Convergence Rates of Two-Component MCMC Samplers

Component-wise MCMC algorithms, including Gibbs and conditional Metropol...
research
11/05/2014

Projecting Markov Random Field Parameters for Fast Mixing

Markov chain Monte Carlo (MCMC) algorithms are simple and extremely powe...
research
12/01/2018

Markov chain Monte Carlo Methods For Lattice Gaussian Sampling: Lattice Reduction and Decoding Optimization

Sampling from the lattice Gaussian distribution has emerged as an import...
research
06/23/2018

On Markov chain Monte Carlo for sparse and filamentary distributions

A novel strategy that combines a given collection of reversible Markov k...
research
01/29/2022

Analysis of two-component Gibbs samplers using the theory of two projections

The theory of two projections is utilized to study two-component Gibbs s...

Please sign up or login with your details

Forgot password? Click here to reset