Accelerating delayed-acceptance Markov chain Monte Carlo algorithms

by   Samuel Wiqvist, et al.

Delayed-acceptance Markov chain Monte Carlo (DA-MCMC) samples from a probability distribution, via a two-stages version of the Metropolis-Hastings algorithm, by combining the target distribution with a "surrogate" (i.e. an approximate and computationally cheaper version) of said distribution. DA-MCMC accelerates MCMC sampling in complex applications, while still targeting the exact distribution. We design a computationally faster DA-MCMC algorithm, which samples from an approximation of the target distribution. As a case study, we also introduce a novel stochastic differential equation model for protein folding data. We consider parameters inference in a Bayesian setting where a surrogate likelihood function is introduced in the delayed-acceptance scheme. In our applications we employ a Gaussian process as a surrogate likelihood, but other options are possible. In our accelerated algorithm the calculations in the "second stage" of the delayed-acceptance scheme are reordered in such as way that we can obtain a significant speed-up in the MCMC sampling, when the evaluation of the likelihood function is computationally intensive. We consider both simulations studies, and the analysis of real protein folding data. Simulation studies for the stochastic Ricker model and the novel stochastic differential equation model for protein-folding data, show that the speed-up is highly problem dependent. The more involved the computations of the likelihood function are, the higher the acceleration becomes when using our algorithm. Inference results for the standard delayed-acceptance algorithm and our approximated version are similar, indicating that our approximated algorithm can return reliable Bayesian inference.


Efficient Bernoulli factory MCMC for intractable likelihoods

Accept-reject based Markov chain Monte Carlo (MCMC) algorithms have trad...

Delayed acceptance ABC-SMC

Approximate Bayesian computation (ABC) is now an established technique f...

Accelerating inference for stochastic kinetic models

Stochastic kinetic models (SKMs) are increasingly used to account for th...

Hierarchical surrogate-based Approximate Bayesian Computation for an electric motor test bench

Inferring parameter distributions of complex industrial systems from noi...

Accelerating sequential Monte Carlo with surrogate likelihoods

Delayed-acceptance is a technique for reducing computational effort for ...

Multielement polynomial chaos Kriging-based metamodelling for Bayesian inference of non-smooth systems

This paper presents a surrogate modelling technique based on domain part...

Efficient inference and identifiability analysis for differential equation models with random parameters

Heterogeneity is a dominant factor in the behaviour of many biological p...

Please sign up or login with your details

Forgot password? Click here to reset