DeepAI AI Chat
Log In Sign Up

Adaptation of the Independent Metropolis-Hastings Sampler with Normalizing Flow Proposals

by   James A. Brofos, et al.

Markov Chain Monte Carlo (MCMC) methods are a powerful tool for computation with complex probability distributions. However the performance of such methods is critically dependant on properly tuned parameters, most of which are difficult if not impossible to know a priori for a given target distribution. Adaptive MCMC methods aim to address this by allowing the parameters to be updated during sampling based on previous samples from the chain at the expense of requiring a new theoretical analysis to ensure convergence. In this work we extend the convergence theory of adaptive MCMC methods to a new class of methods built on a powerful class of parametric density estimators known as normalizing flows. In particular, we consider an independent Metropolis-Hastings sampler where the proposal distribution is represented by a normalizing flow whose parameters are updated using stochastic gradient descent. We explore the practical performance of this procedure on both synthetic settings and in the analysis of a physical field system and compare it against both adaptive and non-adaptive MCMC methods.


page 1

page 2

page 3

page 4


The No-U-Turn Sampler as a Proposal Distribution in a Sequential Monte Carlo Sampler with a Near-Optimal L-Kernel

Markov Chain Monte Carlo (MCMC) is a powerful method for drawing samples...

Accelerating MCMC algorithms through Bayesian Deep Networks

Markov Chain Monte Carlo (MCMC) algorithms are commonly used for their v...

A Neural Network MCMC sampler that maximizes Proposal Entropy

Markov Chain Monte Carlo (MCMC) methods sample from unnormalized probabi...

Adaptive Independent Sticky MCMC algorithms

In this work, we introduce a novel class of adaptive Monte Carlo methods...

Convergence Guarantees for Adaptive Bayesian Quadrature Methods

Adaptive Bayesian quadrature (ABQ) is a powerful approach to numerical i...

Sampling by Divergence Minimization

We introduce a family of Markov Chain Monte Carlo (MCMC) methods designe...

Ergodic variational flows

This work presents a new class of variational family – ergodic variation...