Stochastic Physics-Informed Neural Networks (SPINN): A Moment-Matching Framework for Learning Hidden Physics within Stochastic Differential Equations

09/03/2021
by   Jared O'Leary, et al.
0

Stochastic differential equations (SDEs) are used to describe a wide variety of complex stochastic dynamical systems. Learning the hidden physics within SDEs is crucial for unraveling fundamental understanding of the stochastic and nonlinear behavior of these systems. We propose a flexible and scalable framework for training deep neural networks to learn constitutive equations that represent hidden physics within SDEs. The proposed stochastic physics-informed neural network framework (SPINN) relies on uncertainty propagation and moment-matching techniques along with state-of-the-art deep learning strategies. SPINN first propagates stochasticity through the known structure of the SDE (i.e., the known physics) to predict the time evolution of statistical moments of the stochastic states. SPINN learns (deep) neural network representations of the hidden physics by matching the predicted moments to those estimated from data. Recent advances in automatic differentiation and mini-batch gradient descent are leveraged to establish the unknown parameters of the neural networks. We demonstrate SPINN on three benchmark in-silico case studies and analyze the framework's robustness and numerical stability. SPINN provides a promising new direction for systematically unraveling the hidden physics of multivariate stochastic dynamical systems with multiplicative noise.

READ FULL TEXT
research
02/04/2022

On Neural Differential Equations

The conjoining of dynamical systems and deep learning has become a topic...
research
06/28/2022

Integral Transforms in a Physics-Informed (Quantum) Neural Network setting: Applications Use-Cases

In many computational problems in engineering and science, function or m...
research
08/31/2021

GFINNs: GENERIC Formalism Informed Neural Networks for Deterministic and Stochastic Dynamical Systems

We propose the GENERIC formalism informed neural networks (GFINNs) that ...
research
11/15/2022

Physics-informed neural networks for operator equations with stochastic data

We consider the computation of statistical moments to operator equations...
research
05/09/2017

Stable Architectures for Deep Neural Networks

Deep neural networks have become invaluable tools for supervised machine...
research
07/14/2019

On the Role of Time in Learning

By and large the process of learning concepts that are embedded in time ...
research
09/01/2021

Physics-integrated hybrid framework for model form error identification in nonlinear dynamical systems

For real-life nonlinear systems, the exact form of nonlinearity is often...

Please sign up or login with your details

Forgot password? Click here to reset