Physics-informed radial basis network (PIRBN): A local approximation neural network for solving nonlinear PDEs

04/13/2023
by   Jinshuai Bai, et al.
0

Our recent intensive study has found that physics-informed neural networks (PINN) tend to be local approximators after training. This observation leads to this novel physics-informed radial basis network (PIRBN), which can maintain the local property throughout the entire training process. Compared to deep neural networks, a PIRBN comprises of only one hidden layer and a radial basis "activation" function. Under appropriate conditions, we demonstrated that the training of PIRBNs using gradient descendent methods can converge to Gaussian processes. Besides, we studied the training dynamics of PIRBN via the neural tangent kernel (NTK) theory. In addition, comprehensive investigations regarding the initialisation strategies of PIRBN were conducted. Based on numerical examples, PIRBN has been demonstrated to be more effective and efficient than PINN in solving PDEs with high-frequency features and ill-posed computational domains. Moreover, the existing PINN numerical techniques, such as adaptive learning, decomposition and different types of loss functions, are applicable to PIRBN. The programs that can regenerate all numerical results can be found at https://github.com/JinshuaiBai/PIRBN.

READ FULL TEXT

page 9

page 16

page 25

page 28

page 29

page 30

page 32

page 33

research
11/12/2022

Pre-training strategy for solving evolution equations based on physics-informed neural networks

The physics informed neural network (PINN) is a promising method for sol...
research
12/06/2022

RBF-MGN:Solving spatiotemporal PDEs with Physics-informed Graph Neural Network

Physics-informed neural networks (PINNs) have lately received significan...
research
04/06/2020

Gradient-Based Training and Pruning of Radial Basis Function Networks with an Application in Materials Physics

Many applications, especially in physics and other sciences, call for ea...
research
08/18/2023

Solving PDEs on Spheres with Physics-Informed Convolutional Neural Networks

Physics-informed neural networks (PINNs) have been demonstrated to be ef...
research
10/25/2019

Multi-scale Deep Neural Networks for Solving High Dimensional PDEs

In this paper, we propose the idea of radial scaling in frequency domain...
research
07/22/2020

Multi-scale Deep Neural Network (MscaleDNN) for Solving Poisson-Boltzmann Equation in Complex Domains

In this paper, we propose novel multi-scale DNNs (MscaleDNN) using the i...
research
07/06/2021

The QR decomposition for radial neural networks

We provide a theoretical framework for neural networks in terms of the r...

Please sign up or login with your details

Forgot password? Click here to reset