A Single SMC Sampler on MPI that Outperforms a Single MCMC Sampler

05/24/2019
by   Alessandro Varsi, et al.
0

Markov Chain Monte Carlo (MCMC) is a well-established family of algorithms which are primarily used in Bayesian statistics to sample from a target distribution when direct sampling is challenging. Single instances of MCMC methods are widely considered hard to parallelise in a problem-agnostic fashion and hence, unsuitable to meet both constraints of high accuracy and high throughput. Sequential Monte Carlo (SMC) Samplers can address the same problem, but are parallelisable: they share with Particle Filters the same key tasks and bottleneck. Although a rich literature already exists on MCMC methods, SMC Samplers are relatively underexplored, such that no parallel implementation is currently available. In this paper, we first propose a parallel MPI version of the SMC Sampler, including an optimised implementation of the bottleneck, and then compare it with single-core Metropolis-Hastings. The goal is to show that SMC Samplers may be a promising alternative to MCMC methods with high potential for future improvements. We demonstrate that a basic SMC Sampler with 512 cores is up to 85 times faster or up to 8 times more accurate than Metropolis-Hastings.

READ FULL TEXT
research
01/22/2023

Parallel Approaches to Accelerate Bayesian Decision Trees

Markov Chain Monte Carlo (MCMC) is a well-established family of algorith...
research
02/12/2018

Bouncy Hybrid Sampler as a Unifying Device

This work introduces a class of rejection-free Markov chain Monte Carlo ...
research
06/12/2022

Monte Carlo with Soft Constraints: the Surface Augmented Sampler

We describe an MCMC method for sampling distributions with soft constrai...
research
04/24/2020

Increasing the efficiency of Sequential Monte Carlo samplers through the use of approximately optimal L-kernels

By facilitating the generation of samples from arbitrary probability dis...
research
05/30/2019

Analysis of high-dimensional Continuous Time Markov Chains using the Local Bouncy Particle Sampler

Sampling the parameters of high-dimensional Continuous Time Markov Chain...
research
10/31/2022

Decorrelating ReSTIR Samplers via MCMC Mutations

Monte Carlo rendering algorithms often utilize correlations between pixe...
research
06/08/2023

Entropy-based Training Methods for Scalable Neural Implicit Sampler

Efficiently sampling from un-normalized target distributions is a fundam...

Please sign up or login with your details

Forgot password? Click here to reset