Variational Inverting Network for Statistical Inverse Problems of Partial Differential Equations

01/03/2022
by   Junxiong Jia, et al.
0

To quantify uncertainties of the inverse problems governed by partial differential equations (PDEs), the inverse problems are transformed into statistical inference problems based on Bayes' formula. Recently, infinite-dimensional Bayesian analysis methods are introduced to give a rigorous characterization and construct dimension-independent algorithms. However, there are three major challenges for infinite-dimensional Bayesian methods: prior measures usually only behaves like regularizers (can hardly incorporate prior information efficiently); complex noises (e.g., more practical non-identically distributed noises) are rarely considered; many computationally expensive forward PDEs need to be solved in order to estimate posterior statistical quantities. To address these issues, we propose a general infinite-dimensional inference framework based on a detailed analysis on the infinite-dimensional variational inference method and the ideas of deep generative models that are popular in the machine learning community. Specifically, by introducing some measure equivalence assumptions, we derive the evidence lower bound in the infinite-dimensional setting and provide possible parametric strategies that yield a general inference framework named variational inverting network (VINet). This inference framework has the ability to encode prior and noise information from learning examples. In addition, relying on the power of deep neural networks, the posterior mean and variance can be efficiently generated in the inference stage in an explicit manner. In numerical experiments, we design specific network structures that yield a computable VINet from the general inference framework.Numerical examples of linear inverse problems governed by an elliptic equation and the Helmholtz equation are given to illustrate the effectiveness of the proposed inference framework.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 20

page 23

page 26

page 28

page 30

page 31

07/08/2019

Variational Bayes' method for functions with applications to some inverse problems

Bayesian approach as a useful tool for quantifying uncertainties has bee...
05/09/2022

Efficient algorithms for Bayesian Inverse Problems with Whittle–Matérn Priors

This paper tackles efficient methods for Bayesian inverse problems with ...
02/04/2022

Hyper-differential sensitivity analysis for nonlinear Bayesian inverse problems

We consider hyper-differential sensitivity analysis (HDSA) of nonlinear ...
02/19/2021

Stein variational gradient descent on infinite-dimensional space and applications to statistical inverse problems

For solving Bayesian inverse problems governed by large-scale forward pr...
10/02/2019

A new formulation for the numerical proof of the existence of solutions to elliptic problems

Infinite-dimensional Newton methods can be effectively used to derive nu...
10/15/2018

A unified approach to calculation of information operators in semiparametric models

The infinite-dimensional information operator for the nuisance parameter...
07/20/2021

On some information-theoretic aspects of non-linear statistical inverse problems

Results by van der Vaart (1991) from semi-parametric statistics about th...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.