Increasing the efficiency of Sequential Monte Carlo samplers through the use of approximately optimal L-kernels

04/24/2020
by   Peter L Green, et al.
0

By facilitating the generation of samples from arbitrary probability distributions, Markov Chain Monte Carlo (MCMC) is, arguably, the tool for the evaluation of Bayesian inference problems that yield non-standard posterior distributions. In recent years, however, it has become apparent that Sequential Monte Carlo (SMC) samplers have the potential to outperform MCMC in a number of ways. SMC samplers are better suited to highly parallel computing architectures and also feature various tuning parameters that are not available to MCMC. One such parameter - the `L-kernel' - is a user-defined probability distribution that can be used to influence the efficiency of the sampler. In the current paper, the authors explain how to derive an expression for the L-kernel that minimises the variance of the estimates realised by an SMC sampler. Various approximation methods are then proposed to aid implementation of the proposed L-kernel. The improved performance of the resulting algorithm is demonstrated in multiple scenarios. For the examples shown in the current paper, the use of an approximately optimum L-kernel has reduced the variance of the SMC estimates by up to 99 resampling was required by between 65 accompanying this manuscript are available through the Github repository <https://github.com/plgreenLIRU/SMC_approx_optL>.

READ FULL TEXT

page 20

page 21

research
08/05/2021

The No-U-Turn Sampler as a Proposal Distribution in a Sequential Monte Carlo Sampler with a Near-Optimal L-Kernel

Markov Chain Monte Carlo (MCMC) is a powerful method for drawing samples...
research
07/21/2023

Adaptively switching between a particle marginal Metropolis-Hastings and a particle Gibbs kernel in SMC^2

Sequential Monte Carlo squared (SMC^2; Chopin et al., 2012) methods can ...
research
11/13/2018

Regularised Zero-Variance Control Variates

Zero-variance control variates (ZV-CV) is a post-processing method to re...
research
11/04/2020

Waste-free Sequential Monte Carlo

A standard way to move particles in a SMC sampler is to apply several st...
research
01/10/2013

Variational MCMC

We propose a new class of learning algorithms that combines variational ...
research
11/13/2018

Regularised Zero-Variance Control Variates for High-Dimensional Variance Reduction

Zero-variance control variates (ZV-CV) are a post-processing method to r...
research
05/24/2019

A Single SMC Sampler on MPI that Outperforms a Single MCMC Sampler

Markov Chain Monte Carlo (MCMC) is a well-established family of algorith...

Please sign up or login with your details

Forgot password? Click here to reset