A deep learning framework for multi-scale models based on physics-informed neural networks

08/13/2023
by   Yong Wang, et al.
0

Physics-informed neural networks (PINN) combine deep neural networks with the solution of partial differential equations (PDEs), creating a new and promising research area for numerically solving PDEs. Faced with a class of multi-scale problems that include loss terms of different orders of magnitude in the loss function, it is challenging for standard PINN methods to obtain an available prediction. In this paper, we propose a new framework for solving multi-scale problems by reconstructing the loss function. The framework is based on the standard PINN method, and it modifies the loss function of the standard PINN method by applying different numbers of power operations to the loss terms of different magnitudes, so that the individual loss terms composing the loss function have approximately the same order of magnitude among themselves. In addition, we give a grouping regularization strategy, and this strategy can deal well with the problem which varies significantly in different subdomains. The proposed method enables loss terms with different magnitudes to be optimized simultaneously, and it advances the application of PINN for multi-scale problems.

READ FULL TEXT

page 12

page 13

page 15

page 16

page 19

research
06/23/2023

Solving a class of multi-scale elliptic PDEs by means of Fourier-based mixed physics informed neural networks

Deep neural networks have received widespread attention due to their sim...
research
10/19/2022

A Dimension-Augmented Physics-Informed Neural Network (DaPINN) with High Level Accuracy and Efficiency

Physics-informed neural networks (PINNs) have been widely applied in dif...
research
02/03/2023

LSA-PINN: Linear Boundary Connectivity Loss for Solving PDEs on Complex Geometry

We present a novel loss formulation for efficient learning of complex dy...
research
06/15/2023

PINNacle: A Comprehensive Benchmark of Physics-Informed Neural Networks for Solving PDEs

While significant progress has been made on Physics-Informed Neural Netw...
research
06/24/2023

Current density impedance imaging with PINNs

In this paper, we introduce CDII-PINNs, a computationally efficient meth...
research
12/01/2021

A generic physics-informed neural network-based framework for reliability assessment of multi-state systems

In this paper, we leverage the recent advances in physics-informed neura...
research
06/05/2023

MultiAdam: Parameter-wise Scale-invariant Optimizer for Multiscale Training of Physics-informed Neural Networks

Physics-informed Neural Networks (PINNs) have recently achieved remarkab...

Please sign up or login with your details

Forgot password? Click here to reset