Enhanced gradient-based MCMC in discrete spaces

07/29/2022
by   Benjamin Rhodes, et al.
8

The recent introduction of gradient-based MCMC for discrete spaces holds great promise, and comes with the tantalising possibility of new discrete counterparts to celebrated continuous methods such as MALA and HMC. Towards this goal, we introduce several discrete Metropolis-Hastings samplers that are conceptually-inspired by MALA, and demonstrate their strong empirical performance across a range of challenging sampling problems in Bayesian inference and energy-based modelling. Methodologically, we identify why discrete analogues to preconditioned MALA are generally intractable, motivating us to introduce a new kind of preconditioning based on auxiliary variables and the `Gaussian integral trick'.

READ FULL TEXT

page 1

page 17

page 21

page 22

research
06/04/2013

Fast Gradient-Based Inference with Continuous Latent Variable Models in Auxiliary Form

We propose a technique for increasing the efficiency of gradient-based i...
research
02/04/2021

Sampling in Combinatorial Spaces with SurVAE Flow Augmented MCMC

Hybrid Monte Carlo is a powerful Markov Chain Monte Carlo method for sam...
research
03/14/2023

Discrete gradient methods for irreversible port-Hamiltonian systems

In this paper we introduce discrete gradient methods to discretize irrev...
research
08/02/2020

Conforming Discrete Gradgrad-Complexes in Three Dimensions

In this paper, the first family of conforming discrete three dimensional...
research
10/19/2021

Gradient-Based Mixed Planning with Discrete and Continuous Actions

Dealing with planning problems with both discrete logical relations and ...
research
10/30/2016

Auxiliary gradient-based sampling algorithms

We introduce a new family of MCMC samplers that combine auxiliary variab...
research
06/01/2019

Sparse Bayesian Learning Approach for Discrete Signal Reconstruction

This study addresses the problem of discrete signal reconstruction from ...

Please sign up or login with your details

Forgot password? Click here to reset