Log In Sign Up

Physics-Guided, Physics-Informed, and Physics-Encoded Neural Networks in Scientific Computing

by   Salah A Faroughi, et al.

Recent breakthroughs in computing power have made it feasible to use machine learning and deep learning to advance scientific computing in many fields, such as fluid mechanics, solid mechanics, materials science, etc. Neural networks, in particular, play a central role in this hybridization. Due to their intrinsic architecture, conventional neural networks cannot be successfully trained and scoped when data is sparse; a scenario that is true in many scientific fields. Nonetheless, neural networks offer a strong foundation to digest physical-driven or knowledge-based constraints during training. Generally speaking, there are three distinct neural network frameworks to enforce underlying physics: (i) physics-guided neural networks (PgNN), (ii) physics-informed neural networks (PiNN) and (iii) physics-encoded neural networks (PeNN). These approaches offer unique advantages to accelerate the modeling of complex multiscale multi-physics phenomena. They also come with unique drawbacks and suffer from unresolved limitations (e.g., stability, convergence, and generalization) that call for further research. This study aims to present an in-depth review of the three neural network frameworks (i.e., PgNN, PiNN, and PeNN) used in scientific computing research. The state-of-the-art architectures and their applications are reviewed; limitations are discussed; and future research opportunities in terms of improving algorithms, considering causalities, expanding applications, and coupling scientific and deep learning solvers are presented. This critical review provides a solid starting point for researchers and engineers to comprehend how to integrate different layers of physics into neural networks.


page 10

page 15

page 25


Physics-guided Neural Networks (PGNN): An Application in Lake Temperature Modeling

This paper introduces a novel framework for learning data science models...

Learning Neural Networks with Competing Physics Objectives: An Application in Quantum Mechanics

Physics-guided Machine Learning (PGML) is an emerging field of research ...

Computing by Means of Physics-Based Optical Neural Networks

We report recent research on computing with biology-based neural network...

Explainable artificial intelligence for mechanics: physics-informing neural networks for constitutive models

(Artificial) neural networks have become increasingly popular in mechani...

Self-Validated Physics-Embedding Network: A General Framework for Inverse Modelling

Physics-based inverse modeling techniques are typically restricted to pa...

A Fortran-Keras Deep Learning Bridge for Scientific Computing

Implementing artificial neural networks is commonly achieved via high-le...