Neural oscillators for generalization of physics-informed machine learning

08/17/2023
by   Taniya Kapoor, et al.
0

A primary challenge of physics-informed machine learning (PIML) is its generalization beyond the training domain, especially when dealing with complex physical problems represented by partial differential equations (PDEs). This paper aims to enhance the generalization capabilities of PIML, facilitating practical, real-world applications where accurate predictions in unexplored regions are crucial. We leverage the inherent causality and temporal sequential characteristics of PDE solutions to fuse PIML models with recurrent neural architectures based on systems of ordinary differential equations, referred to as neural oscillators. Through effectively capturing long-time dependencies and mitigating the exploding and vanishing gradient problem, neural oscillators foster improved generalization in PIML tasks. Extensive experimentation involving time-dependent nonlinear PDEs and biharmonic beam equations demonstrates the efficacy of the proposed approach. Incorporating neural oscillators outperforms existing state-of-the-art methods on benchmark problems across various metrics. Consequently, the proposed method improves the generalization capabilities of PIML, providing accurate solutions for extrapolation and prediction beyond the training data.

READ FULL TEXT

page 12

page 13

page 14

research
12/04/2020

DPM: A Novel Training Method for Physics-Informed Neural Networks in Extrapolation

We present a method for learning dynamics of complex physical processes ...
research
03/19/2021

A Physics-Informed Neural Network Framework For Partial Differential Equations on 3D Surfaces: Time-Dependent Problems

In this paper, we show a physics-informed neural network solver for the ...
research
02/15/2023

On the Hyperparameters influencing a PINN's generalization beyond the training domain

Physics-Informed Neural Networks (PINNs) are Neural Network architecture...
research
12/12/2020

Physics-Informed Machine Learning Simulator for Wildfire Propagation

The aim of this work is to evaluate the feasibility of re-implementing s...
research
08/24/2021

GrADE: A graph based data-driven solver for time-dependent nonlinear partial differential equations

The physical world is governed by the laws of physics, often represented...
research
09/20/2021

When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization?

Physics-informed neural networks (PINNs) have become a popular choice fo...
research
06/15/2023

PINNacle: A Comprehensive Benchmark of Physics-Informed Neural Networks for Solving PDEs

While significant progress has been made on Physics-Informed Neural Netw...

Please sign up or login with your details

Forgot password? Click here to reset