Bayesian Deep Learning for Partial Differential Equation Parameter Discovery with Sparse and Noisy Data

08/05/2021
by   Christophe Bonneville, et al.
60

Scientific machine learning has been successfully applied to inverse problems and PDE discoveries in computational physics. One caveat of current methods however is the need for large amounts of (clean) data in order to recover full system responses or underlying physical models. Bayesian methods may be particularly promising to overcome these challenges as they are naturally less sensitive to sparse and noisy data. In this paper, we propose to use Bayesian neural networks (BNN) in order to: 1) Recover the full system states from measurement data (e.g. temperature, velocity field, etc.). We use Hamiltonian Monte-Carlo to sample the posterior distribution of a deep and dense BNN, and show that it is possible to accurately capture physics of varying complexity without overfitting. 2) Recover the parameters in the underlying partial differential equation (PDE) governing the physical system. Using the trained BNN as a surrogate of the system response, we generate datasets of derivatives potentially comprising the latent PDE of the observed system and perform a Bayesian linear regression (BLR) between the successive derivatives in space and time to recover the original PDE parameters. We take advantage of the confidence intervals on the BNN outputs and introduce the spatial derivative variance into the BLR likelihood to discard the influence of highly uncertain surrogate data points, which allows for more accurate parameter discovery. We demonstrate our approach on a handful of example applied to physics and non-linear dynamics.

READ FULL TEXT

page 8

page 15

page 20

page 21

research
11/01/2021

PDE-READ: Human-readable Partial Differential Equation Discovery using Deep Learning

PDE discovery shows promise for uncovering predictive models for complex...
research
10/03/2019

A deep surrogate approach to efficient Bayesian inversion in PDE and integral equation models

We propose a novel deep learning approach to efficiently perform Bayesia...
research
03/18/2021

Identification of Underlying Dynamic System from Noisy Data with Splines

In this paper, we propose a two-stage method called Spline Assisted Part...
research
06/26/2022

Noise-aware Physics-informed Machine Learning for Robust PDE Discovery

This work is concerned with discovering the governing partial differenti...
research
08/20/2023

Adaptive Uncertainty-Guided Model Selection for Data-Driven PDE Discovery

We propose a new parameter-adaptive uncertainty-penalized Bayesian infor...
research
05/25/2021

Surrogate Approximation of the Grad-Shafranov Free Boundary Problem via Stochastic Collocation on Sparse Grids

In magnetic confinement fusion devices, the equilibrium configuration of...
research
06/13/2019

Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networks

In recent years, deep learning has proven to be a viable methodology for...

Please sign up or login with your details

Forgot password? Click here to reset