Kernel Adaptive Metropolis-Hastings

07/19/2013
by   Dino Sejdinovic, et al.
0

A Kernel Adaptive Metropolis-Hastings algorithm is introduced, for the purpose of sampling from a target distribution with strongly nonlinear support. The algorithm embeds the trajectory of the Markov chain into a reproducing kernel Hilbert space (RKHS), such that the feature space covariance of the samples informs the choice of proposal. The procedure is computationally efficient and straightforward to implement, since the RKHS moves can be integrated out analytically: our proposal distribution in the original space is a normal distribution whose mean and covariance depend on where the current sample lies in the support of the target distribution, and adapts to its local covariance structure. Furthermore, the procedure requires neither gradients nor any other higher order information about the target, making it particularly attractive for contexts such as Pseudo-Marginal MCMC. Kernel Adaptive Metropolis-Hastings outperforms competing fixed and adaptive samplers on multivariate, highly nonlinear target distributions, arising in both real-world and synthetic examples. Code may be downloaded at https://github.com/karlnapf/kameleon-mcmc.

READ FULL TEXT

page 3

page 4

page 6

page 7

page 12

research
07/17/2022

The Importance Markov Chain

The Importance Markov chain is a new algorithm bridging the gap between ...
research
08/06/2018

Semblance: A Rank-Based Kernel on Probability Spaces for Niche Detection

Kernel methods provide a principled approach for detecting nonlinear rel...
research
05/23/2023

Optimal Preconditioning and Fisher Adaptive Langevin Sampling

We define an optimal preconditioning for the Langevin diffusion by analy...
research
10/26/2017

Directional Metropolis-Hastings

We propose a new kernel for Metropolis Hastings called Directional Metro...
research
05/02/2021

Sampling by Divergence Minimization

We introduce a family of Markov Chain Monte Carlo (MCMC) methods designe...
research
10/18/2022

Sampling using Adaptive Regenerative Processes

Enriching Brownian Motion with regenerations from a fixed regeneration d...
research
06/29/2022

Cyclical Kernel Adaptive Metropolis

We propose cKAM, cyclical Kernel Adaptive Metropolis, which incorporates...

Please sign up or login with your details

Forgot password? Click here to reset