Accelerating sequential Monte Carlo with surrogate likelihoods

09/08/2020
by   Joshua J Bon, et al.
0

Delayed-acceptance is a technique for reducing computational effort for Bayesian models with expensive likelihoods. Using a delayed-acceptance kernel for Markov chain Monte Carlo can reduce the number of expensive likelihoods evaluations required to approximate a posterior expectation. Delayed-acceptance uses a surrogate, or approximate, likelihood to avoid evaluation of the expensive likelihood when possible. Within the sequential Monte Carlo framework, we utilise the history of the sampler to adaptively tune the surrogate likelihood to yield better approximations of the expensive likelihood, and use a surrogate first annealing schedule to further increase computational efficiency. Moreover, we propose a framework for optimising computation time whilst avoiding particle degeneracy, which encapsulates existing strategies in the literature. Overall, we develop a novel algorithm for computationally efficient SMC with expensive likelihood functions. The method is applied to static Bayesian models, which we demonstrate on toy and real examples, code for which is available at https://github.com/bonStats/smcdar.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/07/2017

Delayed acceptance ABC-SMC

Approximate Bayesian computation (ABC) is now an established technique f...
research
06/15/2018

Accelerating delayed-acceptance Markov chain Monte Carlo algorithms

Delayed-acceptance Markov chain Monte Carlo (DA-MCMC) samples from a pro...
research
06/21/2019

Adaptive Approximate Bayesian Computation Tolerance Selection

Approximate Bayesian Computation (ABC) methods are increasingly used for...
research
08/13/2021

Accelerating the estimation of energetic particle confinement statistics in stellarators using multifidelity Monte Carlo

In the design of stellarators, energetic particle confinement is a criti...
research
03/24/2022

pyABC: Efficient and robust easy-to-use approximate Bayesian computation

The Python package pyABC provides a framework for approximate Bayesian c...
research
08/28/2021

Variational Inference with NoFAS: Normalizing Flow with Adaptive Surrogate for Computationally Expensive Models

Fast inference of numerical model parameters from data is an important p...
research
11/21/2018

Surrogate-assisted parallel tempering for Bayesian neural learning

Parallel tempering addresses some of the drawbacks of canonical Markov C...

Please sign up or login with your details

Forgot password? Click here to reset