Optimization assisted MCMC

09/09/2017
by   Ricky Fok, et al.
0

Markov Chain Monte Carlo (MCMC) sampling methods are widely used but often encounter either slow convergence or biased sampling when applied to multimodal high dimensional distributions. In this paper, we present a general framework of improving classical MCMC samplers by employing a global optimization method. The global optimization method first reduces a high dimensional search to an one dimensional geodesic to find a starting point close to a local mode. The search is accelerated and completed by using a local search method such as BFGS. We modify the target distribution by extracting a local Gaussian distribution aound the found mode. The process is repeated to find all the modes during sampling on the fly. We integrate the optimization algorithm into the Wormhole Hamiltonian Monte Carlo (WHMC) method. Experimental results show that, when applied to high dimensional, multimodal Gaussian mixture models and the network sensor localization problem, the proposed method achieves much faster convergence, with relative error from the mean improved by about an order of magnitude than WHMC in some cases.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/13/2020

Projected Latent Markov Chain Monte Carlo: Conditional Inference with Normalizing Flows

We introduce Projected Latent Markov Chain Monte Carlo (PL-MCMC), a tech...
research
12/06/2018

A Framework for Adaptive MCMC Targeting Multimodal Distributions

We propose a new Monte Carlo method for sampling from multimodal distrib...
research
10/04/2020

High-dimensional Gaussian sampling: a review and a unifying approach based on a stochastic proximal point algorithm

Efficient sampling from a high-dimensional Gaussian distribution is an o...
research
09/27/2018

Fast and Scalable Position-Based Layout Synthesis

The arrangement of objects into a layout can be challenging for non-expe...
research
07/03/2012

The OS* Algorithm: a Joint Approach to Exact Optimization and Sampling

Most current sampling algorithms for high-dimensional distributions are ...
research
10/31/2017

Nebula: F0 Estimation and Voicing Detection by Modeling the Statistical Properties of Feature Extractors

A F0 and voicing status estimation algorithm for speech analysis/synthes...
research
11/12/2021

Sampling from multimodal distributions using tempered Hamiltonian transitions

Hamiltonian Monte Carlo (HMC) methods are widely used to draw samples fr...

Please sign up or login with your details

Forgot password? Click here to reset