Variational Inverting Network for Statistical Inverse Problems of Partial Differential Equations

01/03/2022
by   Junxiong Jia, et al.
0

To quantify uncertainties of the inverse problems governed by partial differential equations (PDEs), the inverse problems are transformed into statistical inference problems based on Bayes' formula. Recently, infinite-dimensional Bayesian analysis methods are introduced to give a rigorous characterization and construct dimension-independent algorithms. However, there are three major challenges for infinite-dimensional Bayesian methods: prior measures usually only behaves like regularizers (can hardly incorporate prior information efficiently); complex noises (e.g., more practical non-identically distributed noises) are rarely considered; many computationally expensive forward PDEs need to be solved in order to estimate posterior statistical quantities. To address these issues, we propose a general infinite-dimensional inference framework based on a detailed analysis on the infinite-dimensional variational inference method and the ideas of deep generative models that are popular in the machine learning community. Specifically, by introducing some measure equivalence assumptions, we derive the evidence lower bound in the infinite-dimensional setting and provide possible parametric strategies that yield a general inference framework named variational inverting network (VINet). This inference framework has the ability to encode prior and noise information from learning examples. In addition, relying on the power of deep neural networks, the posterior mean and variance can be efficiently generated in the inference stage in an explicit manner. In numerical experiments, we design specific network structures that yield a computable VINet from the general inference framework.Numerical examples of linear inverse problems governed by an elliptic equation and the Helmholtz equation are given to illustrate the effectiveness of the proposed inference framework.

READ FULL TEXT

page 20

page 23

page 26

page 28

page 30

page 31

research
07/08/2019

Variational Bayes' method for functions with applications to some inverse problems

Bayesian approach as a useful tool for quantifying uncertainties has bee...
research
11/19/2022

Non-centered parametric variational Bayes' approach for hierarchical inverse problems of partial differential equations

This paper proposes a non-centered parameterization based infinite-dimen...
research
02/22/2023

VI-DGP: A variational inference method with deep generative prior for solving high-dimensional inverse problems

Solving high-dimensional Bayesian inverse problems (BIPs) with the varia...
research
08/15/2023

A Statistical Framework and Analysis for Perfect Radar Pulse Compression

Perfect radar pulse compression coding is a potential emerging field whi...
research
10/02/2019

A new formulation for the numerical proof of the existence of solutions to elliptic problems

Infinite-dimensional Newton methods can be effectively used to derive nu...
research
02/19/2021

Stein variational gradient descent on infinite-dimensional space and applications to statistical inverse problems

For solving Bayesian inverse problems governed by large-scale forward pr...
research
01/09/2023

A domain-decomposed VAE method for Bayesian inverse problems

Bayesian inverse problems are often computationally challenging when the...

Please sign up or login with your details

Forgot password? Click here to reset