DeepAI
Log In Sign Up

Deterministic Gibbs Sampling via Ordinary Differential Equations

06/18/2021
by   Kirill Neklyudov, et al.
0

Deterministic dynamics is an essential part of many MCMC algorithms, e.g. Hybrid Monte Carlo or samplers utilizing normalizing flows. This paper presents a general construction of deterministic measure-preserving dynamics using autonomous ODEs and tools from differential geometry. We show how Hybrid Monte Carlo and other deterministic samplers follow as special cases of our theory. We then demonstrate the utility of our approach by constructing a continuous non-sequential version of Gibbs sampling in terms of an ODE flow and extending it to discrete state spaces. We find that our deterministic samplers are more sample efficient than stochastic counterparts, even if the latter generate independent samples.

READ FULL TEXT

page 1

page 4

page 7

page 8

page 13

10/15/2021

Método de Monte Carlo aplicado ao Cálculo Fracionário

This article analyzes and develops a method to solve fractional ordinary...
02/04/2021

Sampling in Combinatorial Spaces with SurVAE Flow Augmented MCMC

Hybrid Monte Carlo is a powerful Markov Chain Monte Carlo method for sam...
08/17/2019

Prune Sampling: a MCMC inference technique for discrete and deterministic Bayesian networks

We introduce and characterise the performance of the Markov chain Monte ...
08/19/2020

Monte Carlo construction of cubature on Wiener space

In this paper, we investigate application of mathematical optimization t...
10/09/2017

New Insights into History Matching via Sequential Monte Carlo

The aim of the history matching method is to locate non-implausible regi...
06/17/2022

Accelerated Kinetic Monte Carlo methods for general nonlocal traffic flow models

This paper presents a class of one-dimensional cellular automata (CA) mo...