SVD-PINNs: Transfer Learning of Physics-Informed Neural Networks via Singular Value Decomposition

11/16/2022
by   Yihang Gao, et al.
0

Physics-informed neural networks (PINNs) have attracted significant attention for solving partial differential equations (PDEs) in recent years because they alleviate the curse of dimensionality that appears in traditional methods. However, the most disadvantage of PINNs is that one neural network corresponds to one PDE. In practice, we usually need to solve a class of PDEs, not just one. With the explosive growth of deep learning, many useful techniques in general deep learning tasks are also suitable for PINNs. Transfer learning methods may reduce the cost for PINNs in solving a class of PDEs. In this paper, we proposed a transfer learning method of PINNs via keeping singular vectors and optimizing singular values (namely SVD-PINNs). Numerical experiments on high dimensional PDEs (10-d linear parabolic equations and 10-d Allen-Cahn equations) show that SVD-PINNs work for solving a class of PDEs with different but close right-hand-side functions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/07/2023

A physics-informed neural network framework for modeling obstacle-related equations

Deep learning has been highly successful in some applications. Neverthel...
research
04/12/2023

Maximum-likelihood Estimators in Physics-Informed Neural Networks for High-dimensional Inverse Problems

Physics-informed neural networks (PINNs) have proven a suitable mathemat...
research
05/10/2023

Global Convergence of Deep Galerkin and PINNs Methods for Solving Partial Differential Equations

Numerically solving high-dimensional partial differential equations (PDE...
research
01/27/2023

TransNet: Transferable Neural Networks for Partial Differential Equations

Transfer learning for partial differential equations (PDEs) is to develo...
research
10/28/2022

Data-driven discovery of Green's functions

Discovering hidden partial differential equations (PDEs) and operators f...
research
02/25/2023

Ensemble learning for Physics Informed Neural Networks: a Gradient Boosting approach

While the popularity of physics-informed neural networks (PINNs) is stea...
research
03/28/2023

SVD-DIP: Overcoming the Overfitting Problem in DIP-based CT Reconstruction

The deep image prior (DIP) is a well-established unsupervised deep learn...

Please sign up or login with your details

Forgot password? Click here to reset