Scalable algorithms for physics-informed neural and graph networks

05/16/2022
by   Khemraj Shukla, et al.
20

Physics-informed machine learning (PIML) has emerged as a promising new approach for simulating complex physical and biological systems that are governed by complex multiscale processes for which some data are also available. In some instances, the objective is to discover part of the hidden physics from the available data, and PIML has been shown to be particularly effective for such problems for which conventional methods may fail. Unlike commercial machine learning where training of deep neural networks requires big data, in PIML big data are not available. Instead, we can train such networks from additional information obtained by employing the physical laws and evaluating them at random points in the space-time domain. Such physics-informed machine learning integrates multimodality and multifidelity data with mathematical models, and implements them using neural networks or graph networks. Here, we review some of the prevailing trends in embedding physics into machine learning, using physics-informed neural networks (PINNs) based primarily on feed-forward neural networks and automatic differentiation. For more complex systems or systems of systems and unstructured data, graph neural networks (GNNs) present some distinct advantages, and here we review how physics-informed learning can be accomplished with GNNs based on graph exterior calculus to construct differential operators; we refer to these architectures as physics-informed graph networks (PIGNs). We present representative examples for both forward and inverse problems and discuss what advances are needed to scale up PINNs, PIGNs and more broadly GNNs for large-scale engineering problems.

READ FULL TEXT

page 1

page 10

page 12

research
11/15/2022

Physics-Informed Machine Learning: A Survey on Problems, Methods and Applications

Recent advances of data-driven machine learning have revolutionized fiel...
research
10/25/2021

Physics Informed Machine Learning of SPH: Machine Learning Lagrangian Turbulence

Smoothed particle hydrodynamics (SPH) is a mesh-free Lagrangian method f...
research
05/20/2021

Physics-informed neural networks (PINNs) for fluid mechanics: A review

Despite the significant progress over the last 50 years in simulating fl...
research
03/27/2021

Why Do Big Data and Machine Learning Entail the Fractional Dynamics?

Fractional-order calculus is about the differentiation and integration o...
research
03/02/2021

ForceNet: A Graph Neural Network for Large-Scale Quantum Calculations

With massive amounts of atomic simulation data available, there is a hug...
research
05/11/2023

Physics-Informed Neural Networks for Discovering Localised Eigenstates in Disordered Media

The Schrödinger equation with random potentials is a fundamental model f...
research
03/30/2021

TensorDiffEq: Scalable Multi-GPU Forward and Inverse Solvers for Physics Informed Neural Networks

Physics-Informed Neural Networks promise to revolutionize science and en...

Please sign up or login with your details

Forgot password? Click here to reset