Projecting Markov Random Field Parameters for Fast Mixing

11/05/2014
by   Xianghang Liu, et al.
0

Markov chain Monte Carlo (MCMC) algorithms are simple and extremely powerful techniques to sample from almost arbitrary distributions. The flaw in practice is that it can take a large and/or unknown amount of time to converge to the stationary distribution. This paper gives sufficient conditions to guarantee that univariate Gibbs sampling on Markov Random Fields (MRFs) will be fast mixing, in a precise sense. Further, an algorithm is given to project onto this set of fast-mixing parameters in the Euclidean norm. Following recent work, we give an example use of this to project in various divergence measures, comparing univariate marginals obtained by sampling after projection to common variational methods and Gibbs sampling on the original parameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/24/2021

Sequential pCN-MCMC, an efficient MCMC method for Bayesian inversion of high-dimensional multi-Gaussian priors

In geostatistics, Gaussian random fields are often used to model heterog...
research
07/03/2014

Projecting Ising Model Parameters for Fast Mixing

Inference in general Ising models is difficult, due to high treewidth ma...
research
06/06/2015

Fast Mixing for Discrete Point Processes

We investigate the systematic mechanism for designing fast mixing Markov...
research
09/30/2015

Maximum Likelihood Learning With Arbitrary Treewidth via Fast-Mixing Parameter Sets

Inference is typically intractable in high-treewidth undirected graphica...
research
08/03/2020

The Amazing Power of Randomness: NP=RP

We (claim to) prove the extremely surprising fact that NP=RP. It is achi...
research
06/10/2016

Scan Order in Gibbs Sampling: Models in Which it Matters and Bounds on How Much

Gibbs sampling is a Markov Chain Monte Carlo sampling technique that ite...
research
01/11/2017

Fast mixing for Latent Dirichlet allocation

Markov chain Monte Carlo (MCMC) algorithms are ubiquitous in probability...

Please sign up or login with your details

Forgot password? Click here to reset