Cyclical Kernel Adaptive Metropolis

06/29/2022
by   Jianan Canal Li, et al.
0

We propose cKAM, cyclical Kernel Adaptive Metropolis, which incorporates a cyclical stepsize scheme to allow control for exploration and sampling. We show that on a crafted bimodal distribution, existing Adaptive Metropolis type algorithms would fail to converge to the true posterior distribution. We point out that this is because adaptive samplers estimates the local/global covariance structure using past history of the chain, which will lead to adaptive algorithms be trapped in a local mode. We demonstrate that cKAM encourages exploration of the posterior distribution and allows the sampler to escape from a local mode, while maintaining the high performance of adaptive methods.

READ FULL TEXT

page 4

page 5

page 6

page 9

research
11/27/2019

Spike and Slab Pólya tree posterior distributions

In the density estimation model, the question of adaptive inference usin...
research
11/08/2018

Practical Bayesian Learning of Neural Networks via Adaptive Subgradient Methods

We introduce a novel framework for the estimation of the posterior distr...
research
12/24/2021

Annealed Leap-Point Sampler for Multimodal Target Distributions

In Bayesian statistics, exploring multimodal posterior distribution pose...
research
07/01/2015

Bootstrapped Thompson Sampling and Deep Exploration

This technical note presents a new approach to carrying out the kind of ...
research
10/29/2015

Covariance-Controlled Adaptive Langevin Thermostat for Large-Scale Bayesian Sampling

Monte Carlo sampling for Bayesian posterior inference is a common approa...
research
08/03/2023

Bag of Policies for Distributional Deep Exploration

Efficient exploration in complex environments remains a major challenge ...
research
07/19/2013

Kernel Adaptive Metropolis-Hastings

A Kernel Adaptive Metropolis-Hastings algorithm is introduced, for the p...

Please sign up or login with your details

Forgot password? Click here to reset