Variational Bayesian Approximation of Inverse Problems using Sparse Precision Matrices

10/22/2021
by   Jan Povala, et al.
0

Inverse problems involving partial differential equations (PDEs) are widely used in science and engineering. Although such problems are generally ill-posed, different regularisation approaches have been developed to ameliorate this problem. Among them is the Bayesian formulation, where a prior probability measure is placed on the quantity of interest. The resulting posterior probability measure is usually analytically intractable. The Markov Chain Monte Carlo (MCMC) method has been the go-to method for sampling from those posterior measures. MCMC is computationally infeasible for large-scale problems that arise in engineering practice. Lately, Variational Bayes (VB) has been recognised as a more computationally tractable method for Bayesian inference, approximating a Bayesian posterior distribution with a simpler trial distribution by solving an optimisation problem. In this work, we argue, through an empirical assessment, that VB methods are a flexible and efficient alternative to MCMC for this class of problems. We propose a natural choice of a family of Gaussian trial distributions parametrised by precision matrices, thus taking advantage of the inherent sparsity of the inverse problem encoded in its finite element discretisation. We utilise stochastic optimisation to efficiently estimate the variational objective and assess not only the error in the solution mean but also the ability to quantify the uncertainty of the estimate. We test this on PDEs based on the Poisson equation in 1D and 2D. A Tensorflow implementation is made publicly available on GitHub.

READ FULL TEXT

page 23

page 24

page 26

research
08/30/2019

Reduced-order modeling for nonlinear Bayesian statistical inverse problems

Bayesian statistical inverse problems are often solved with Markov chain...
research
07/08/2019

Variational Bayes' method for functions with applications to some inverse problems

Bayesian approach as a useful tool for quantifying uncertainties has bee...
research
02/08/2021

Novel Deep neural networks for solving Bayesian statistical inverse

We consider the simulation of Bayesian statistical inverse problems gove...
research
10/15/2018

Inverse Problems and Data Assimilation

These notes are designed with the aim of providing a clear and concise i...
research
02/14/2021

A benchmark for the Bayesian inversion of coefficients in partial differential equations

Bayesian methods have been widely used in the last two decades to infer ...
research
10/24/2017

A hierarchical Bayesian perspective on majorization-minimization for non-convex sparse regression: application to M/EEG source imaging

Majorization-minimization (MM) is a standard iterative optimization tech...
research
02/11/2019

Estimating the Rate Constant from Biosensor Data via an Adaptive Variational Bayesian Approach

The means to obtain the rate constants of a chemical reaction is a funda...

Please sign up or login with your details

Forgot password? Click here to reset