Generalized Transitional Markov Chain Monte Carlo Sampling Technique for Bayesian Inversion

12/03/2021
by   Han Lu, et al.
0

In the context of Bayesian inversion for scientific and engineering modeling, Markov chain Monte Carlo sampling strategies are the benchmark due to their flexibility and robustness in dealing with arbitrary posterior probability density functions (PDFs). However, these algorithms been shown to be inefficient when sampling from posterior distributions that are high-dimensional or exhibit multi-modality and/or strong parameter correlations. In such contexts, the sequential Monte Carlo technique of transitional Markov chain Monte Carlo (TMCMC) provides a more efficient alternative. Despite the recent applicability for Bayesian updating and model selection across a variety of disciplines, TMCMC may require a prohibitive number of tempering stages when the prior PDF is significantly different from the target posterior. Furthermore, the need to start with an initial set of samples from the prior distribution may present a challenge when dealing with implicit priors, e.g. based on feasible regions. Finally, TMCMC can not be used for inverse problems with improper prior PDFs that represent lack of prior knowledge on all or a subset of parameters. In this investigation, a generalization of TMCMC that alleviates such challenges and limitations is proposed, resulting in a tempering sampling strategy of enhanced robustness and computational efficiency. Convergence analysis of the proposed sequential Monte Carlo algorithm is presented, proving that the distance between the intermediate distributions and the target posterior distribution monotonically decreases as the algorithm proceeds. The enhanced efficiency associated with the proposed generalization is highlighted through a series of test inverse problems and an engineering application in the oil and gas industry.

READ FULL TEXT
research
11/30/2020

A Markov Chain Monte-Carlo Approach to Dose-Response Optimization Using Probabilistic Programming (RStan)

A hierarchical logistic regression Bayesian model is proposed and implem...
research
12/02/2018

Efficiency and robustness in Monte Carlo sampling of 3-D geophysical inversions with Obsidian v0.1.2: Setting up for success

The rigorous quantification of uncertainty in geophysical inversions is ...
research
07/26/2017

Prior specification for binary Markov mesh models

We propose prior distributions for all parts of the specification of a M...
research
01/10/2021

Randomised maximum likelihood based posterior sampling

Minimization of a stochastic cost function is commonly used for approxim...
research
08/18/2020

Bayesian geoacoustic inversion using mixture density network

Bayesian geoacoustic inversion problems are conventionally solved by Mar...
research
10/15/2019

Adversarial Numerical Analysis for Inverse Problems

Many scientific and engineering applications are formulated as inverse p...
research
01/12/2018

Deep Learning for Sampling from Arbitrary Probability Distributions

This paper proposes a fully connected neural network model to map sample...

Please sign up or login with your details

Forgot password? Click here to reset