Markov Chain Truncation for Doubly-Intractable Inference

10/15/2016
by   Colin Wei, et al.
0

Computing partition functions, the normalizing constants of probability distributions, is often hard. Variants of importance sampling give unbiased estimates of a normalizer Z, however, unbiased estimates of the reciprocal 1/Z are harder to obtain. Unbiased estimates of 1/Z allow Markov chain Monte Carlo sampling of "doubly-intractable" distributions, such as the parameter posterior for Markov Random Fields or Exponential Random Graphs. We demonstrate how to construct unbiased estimates for 1/Z given access to black-box importance sampling estimators for Z. We adapt recent work on random series truncation and Markov chain coupling, producing estimators with lower variance and a higher percentage of positive estimates than before. Our debiasing algorithms are simple to implement, and have some theoretical and empirical advantages over existing methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/14/2017

Model comparison for Gibbs random fields using noisy reversible jump Markov chain Monte Carlo

The reversible jump Markov chain Monte Carlo (RJMCMC) method offers an a...
research
10/02/2018

Unbiased estimation of log normalizing constants with applications to Bayesian cross-validation

Posterior distributions often feature intractable normalizing constants,...
research
03/07/2016

Partition Functions from Rao-Blackwellized Tempered Sampling

Partition functions of probability distributions are important quantitie...
research
04/08/2022

Free Energy Evaluation Using Marginalized Annealed Importance Sampling

The evaluation of the free energy of a stochastic model is considered to...
research
05/17/2023

Stein Π-Importance Sampling

Stein discrepancies have emerged as a powerful tool for retrospective im...
research
03/15/2017

A New Unbiased and Efficient Class of LSH-Based Samplers and Estimators for Partition Function Computation in Log-Linear Models

Log-linear models are arguably the most successful class of graphical mo...
research
07/11/2023

Optimal importance sampling for overdamped Langevin dynamics

Calculating averages with respect to multimodal probability distribution...

Please sign up or login with your details

Forgot password? Click here to reset