Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems

09/21/2018
by   Dongkun Zhang, et al.
0

Physics-informed neural networks (PINNs) have recently emerged as an alternative way of solving partial differential equations (PDEs) without the need of building elaborate grids, instead, using a straightforward implementation. In particular, in addition to the deep neural network (DNN) for the solution, a second DNN is considered that represents the residual of the PDE. The residual is then combined with the mismatch in the given data of the solution in order to formulate the loss function. This framework is effective but is lacking uncertainty quantification of the solution due to the inherent randomness in the data or due to the approximation limitations of the DNN architecture. Here, we propose a new method with the objective of endowing the DNN with uncertainty quantification for both sources of uncertainty, i.e., the parametric uncertainty and the approximation uncertainty. We first account for the parametric uncertainty when the parameter in the differential equation is represented as a stochastic process. Multiple DNNs are designed to learn the modal functions of the arbitrary polynomial chaos (aPC) expansion of its solution by using stochastic data from sparse sensors. We can then make predictions from new sensor measurements very efficiently with the trained DNNs. Moreover, we employ dropout to correct the over-fitting and also to quantify the uncertainty of DNNs in approximating the modal functions. We then design an active learning strategy based on the dropout uncertainty to place new sensors in the domain to improve the predictions of DNNs. Several numerical tests are conducted for both the forward and the inverse problems to quantify the effectiveness of PINNs combined with uncertainty quantification. This NN-aPC new paradigm of physics-informed deep learning with uncertainty quantification can be readily applied to other types of stochastic PDEs in multi-dimensions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/13/2020

B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Data

We propose a Bayesian physics-informed neural network (B-PINN) to solve ...
research
02/07/2023

IB-UQ: Information bottleneck based uncertainty quantification for neural function regression and neural operator learning

In this paper, a novel framework is established for uncertainty quantifi...
research
10/29/2019

Highly-scalable, physics-informed GANs for learning solutions of stochastic PDEs

Uncertainty quantification for forward and inverse problems is a central...
research
01/13/2021

Bayesian neural networks for weak solution of PDEs with uncertainty quantification

Solving partial differential equations (PDEs) is the canonical approach ...
research
02/08/2022

Physics-informed neural networks for solving parametric magnetostatic problems

The optimal design of magnetic devices becomes intractable using current...
research
06/01/2020

One Versus all for deep Neural Network Incertitude (OVNNI) quantification

Deep neural networks (DNNs) are powerful learning models yet their resul...
research
03/19/2022

Wavenumber-explicit parametric holomorphy of Helmholtz solutions in the context of uncertainty quantification

A crucial role in the theory of uncertainty quantification (UQ) of PDEs ...

Please sign up or login with your details

Forgot password? Click here to reset