Log In Sign Up

Deterministic Gibbs Sampling via Ordinary Differential Equations

by   Kirill Neklyudov, et al.

Deterministic dynamics is an essential part of many MCMC algorithms, e.g. Hybrid Monte Carlo or samplers utilizing normalizing flows. This paper presents a general construction of deterministic measure-preserving dynamics using autonomous ODEs and tools from differential geometry. We show how Hybrid Monte Carlo and other deterministic samplers follow as special cases of our theory. We then demonstrate the utility of our approach by constructing a continuous non-sequential version of Gibbs sampling in terms of an ODE flow and extending it to discrete state spaces. We find that our deterministic samplers are more sample efficient than stochastic counterparts, even if the latter generate independent samples.


page 1

page 4

page 7

page 8

page 13


Método de Monte Carlo aplicado ao Cálculo Fracionário

This article analyzes and develops a method to solve fractional ordinary...

Sampling in Combinatorial Spaces with SurVAE Flow Augmented MCMC

Hybrid Monte Carlo is a powerful Markov Chain Monte Carlo method for sam...

Prune Sampling: a MCMC inference technique for discrete and deterministic Bayesian networks

We introduce and characterise the performance of the Markov chain Monte ...

Monte Carlo construction of cubature on Wiener space

In this paper, we investigate application of mathematical optimization t...

New Insights into History Matching via Sequential Monte Carlo

The aim of the history matching method is to locate non-implausible regi...

Accelerated Kinetic Monte Carlo methods for general nonlocal traffic flow models

This paper presents a class of one-dimensional cellular automata (CA) mo...