Multilevel Delayed Acceptance MCMC

02/08/2022
by   Mikkel B. Lykkegaard, et al.
0

We develop a novel Markov chain Monte Carlo (MCMC) method that exploits a hierarchy of models of increasing complexity to efficiently generate samples from an unnormalized target distribution. Broadly, the method rewrites the Multilevel MCMC approach of Dodwell et al. (2015) in terms of the Delayed Acceptance (DA) MCMC of Christen Fox (2005). In particular, DA is extended to use a hierarchy of models of arbitrary depth, and allow subchains of arbitrary length. We show that the algorithm satisfies detailed balance, hence is ergodic for the target distribution. Furthermore, multilevel variance reduction is derived that exploits the multiple levels and subchains, and an adaptive multilevel correction to coarse-level biases is developed. Three numerical examples of Bayesian inverse problems are presented that demonstrate the advantages of these novel methods. The software and examples are available in PyMC3.

READ FULL TEXT

page 16

page 20

research
12/10/2020

Multilevel Delayed Acceptance MCMC with an Adaptive Error Model in PyMC3

Uncertainty Quantification through Markov Chain Monte Carlo (MCMC) can b...
research
10/28/2019

Multilevel Dimension-Independent Likelihood-Informed MCMC for Large-Scale Inverse Problems

We present a non-trivial integration of dimension-independent likelihood...
research
05/05/2021

Analysis of a class of Multi-Level Markov Chain Monte Carlo algorithms based on Independent Metropolis-Hastings

In this work, we present, analyze, and implement a class of Multi-Level ...
research
07/28/2020

Multilevel Hierarchical Decomposition of Finite Element White Noise with Application to Multilevel Markov Chain Monte Carlo

In this work we develop a new hierarchical multilevel approach to genera...
research
02/01/2023

Multilevel Markov Chain Monte Carlo for Bayesian Elliptic Inverse Problems with Besov Random Tree Priors

We propose a multilevel Monte Carlo-FEM algorithm to solve elliptic Baye...
research
11/27/2020

A splitting method to reduce MCMC variance

We explore whether splitting and killing methods can improve the accurac...
research
04/05/2021

Multilevel Stein variational gradient descent with applications to Bayesian inverse problems

This work presents a multilevel variant of Stein variational gradient de...

Please sign up or login with your details

Forgot password? Click here to reset