Non-reversible jump algorithms for Bayesian nested model selection

11/04/2019
by   Philippe Gagnon, et al.
0

Non-reversible Markov chain Monte Carlo methods often outperform their reversible counterparts in terms of asymptotic variance of ergodic averages and mixing properties. Lifting the state-space (Chen et al., 1999; Diaconis et al., 2000) is a generic technique for constructing such samplers. The idea is to think of the random variables we want to generate as position variables and to associate to them direction variables so as to design Markov chains which do not have the diffusive behaviour often exhibited by reversible schemes. In this paper, we explore the benefits of using such ideas in the context of Bayesian model choice for nested models, a class of models for which the model indicator variable is an ordinal random variable. By lifting this model indicator variable, we obtain non-reversible jump algorithms, a non-reversible version of the popular reversible jump algorithms introduced by Green (1995). This simple algorithmic modification provides samplers which can empirically outperform their reversible counterparts at no extra computational cost. The code to reproduce all experiments is available online.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/07/2018

Note on the convergence time of some non-reversible Markov chain Monte Carlo methods

Introduced in statistical physics, non-reversible Markov chain Monte Car...
research
03/11/2020

Lifted samplers for partially ordered discrete state-spaces

A technique called lifting is employed in practice for avoiding that the...
research
07/31/2023

Geometric ergodicity of trans-dimensional Markov chain Monte Carlo algorithms

This article studies the convergence properties of trans-dimensional MCM...
research
03/17/2014

A reversible infinite HMM using normalised random measures

We present a nonparametric prior over reversible Markov chains. We use c...
research
07/03/2023

Bayesian variable selection using an informed reversible jump in imaging genetics: an application to schizophrenia

Modern attempts in providing predictive risk for complex disorders, such...
research
05/08/2019

Non-Reversible Parallel Tempering: an Embarassingly Parallel MCMC Scheme

Parallel tempering (PT) methods are a popular class of Markov chain Mont...
research
05/12/2020

Non-reversible guided Metropolis-Hastings kernel

We construct a non-reversible Metropolis-Hastings kernel as a multivaria...

Please sign up or login with your details

Forgot password? Click here to reset