Bayesian neural networks for weak solution of PDEs with uncertainty quantification

01/13/2021
by   Xiaoxuan Zhang, et al.
52

Solving partial differential equations (PDEs) is the canonical approach for understanding the behavior of physical systems. However, large scale solutions of PDEs using state of the art discretization techniques remains an expensive proposition. In this work, a new physics-constrained neural network (NN) approach is proposed to solve PDEs without labels, with a view to enabling high-throughput solutions in support of design and decision-making. Distinct from existing physics-informed NN approaches, where the strong form or weak form of PDEs are used to construct the loss function, we write the loss function of NNs based on the discretized residual of PDEs through an efficient, convolutional operator-based, and vectorized implementation. We explore an encoder-decoder NN structure for both deterministic and probabilistic models, with Bayesian NNs (BNNs) for the latter, which allow us to quantify both epistemic uncertainty from model parameters and aleatoric uncertainty from noise in the data. For BNNs, the discretized residual is used to construct the likelihood function. In our approach, both deterministic and probabilistic convolutional layers are used to learn the applied boundary conditions (BCs) and to detect the problem domain. As both Dirichlet and Neumann BCs are specified as inputs to NNs, a single NN can solve for similar physics, but with different BCs and on a number of problem domains. The trained surrogate PDE solvers can also make interpolating and extrapolating (to a certain extent) predictions for BCs that they were not exposed to during training. Such surrogate models are of particular importance for problems, where similar types of PDEs need to be repeatedly solved for many times with slight variations. We demonstrate the capability and performance of the proposed framework by applying it to steady-state diffusion, linear elasticity, and nonlinear elasticity.

READ FULL TEXT

page 16

page 20

page 24

page 28

page 29

page 32

page 33

page 34

research
03/15/2021

dNNsolve: an efficient NN-based PDE solver

Neural Networks (NNs) can be used to solve Ordinary and Partial Differen...
research
09/21/2018

Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems

Physics-informed neural networks (PINNs) have recently emerged as an alt...
research
09/14/2021

Non-linear Independent Dual System (NIDS) for Discretization-independent Surrogate Modeling over Complex Geometries

Numerical solutions of partial differential equations (PDEs) require exp...
research
05/16/2023

Deep Fourier Residual method for solving time-harmonic Maxwell's equations

Solving PDEs with machine learning techniques has become a popular alter...
research
12/23/2022

Physics-Informed Gaussian Process Regression Generalizes Linear PDE Solvers

Linear partial differential equations (PDEs) are an important, widely ap...
research
03/24/2022

The Cost-Accuracy Trade-Off In Operator Learning With Neural Networks

The term `surrogate modeling' in computational science and engineering r...

Please sign up or login with your details

Forgot password? Click here to reset