Haar-Weave-Metropolis kernel

11/11/2021
by   Kengo Kamatani, et al.
0

Recently, many Markov chain Monte Carlo methods have been developed with deterministic reversible transform proposals inspired by the Hamiltonian Monte Carlo method. The deterministic transform is relatively easy to reconcile with the local information (gradient etc.) of the target distribution. However, as the ergodic theory suggests, these deterministic proposal methods seem to be incompatible with robustness and lead to poor convergence, especially in the case of target distributions with heavy tails. On the other hand, the Markov kernel using the Haar measure is relatively robust since it learns global information about the target distribution introducing global parameters. However, it requires a density preserving condition, and many deterministic proposals break this condition. In this paper, we carefully select deterministic transforms that preserve the structure and create a Markov kernel, the Weave-Metropolis kernel, using the deterministic transforms. By combining with the Haar measure, we also introduce the Haar-Weave-Metropolis kernel. In this way, the Markov kernel can employ the local information of the target distribution using the deterministic proposal, and thanks to the Haar measure, it can employ the global information of the target distribution. Finally, we show through numerical experiments that the performance of the proposed method is superior to other methods in terms of effective sample size and mean square jump distance per second.

READ FULL TEXT
research
04/08/2018

Accelerating MCMC Algorithms

Markov chain Monte Carlo algorithms are used to simulate from complex st...
research
11/05/2019

A step further towards automatic and efficient reversible jump algorithms

Incorporating information about the target distribution in proposal mech...
research
05/12/2020

Non-reversible guided Metropolis-Hastings kernel

We construct a non-reversible Metropolis-Hastings kernel as a multivaria...
research
02/02/2019

Numerical Integration Method for Training Neural Network

We propose a new numerical integration method for training a shallow neu...
research
12/29/2020

A general perspective on the Metropolis-Hastings kernel

Since its inception the Metropolis-Hastings kernel has been applied in s...
research
10/27/2021

Entropy-based adaptive Hamiltonian Monte Carlo

Hamiltonian Monte Carlo (HMC) is a popular Markov Chain Monte Carlo (MCM...
research
07/11/2017

Initialising Kernel Adaptive Filters via Probabilistic Inference

We present a probabilistic framework for both (i) determining the initia...

Please sign up or login with your details

Forgot password? Click here to reset