Convergence Analysis for the PINNs

09/04/2021
by   Yuling Jiao, et al.
0

In recent years, physical informed neural networks (PINNs) have been shown to be a powerful tool for solving PDEs empirically. However, numerical analysis of PINNs is still missing. In this paper, we prove the convergence rate to PINNs for the second order elliptic equations with Dirichlet boundary condition, by establishing the upper bounds on the number of training samples, depth and width of the deep neural networks to achieve desired accuracy. The error of PINNs is decomposed into approximation error and statistical error, where the approximation error is given in C^2 norm with ReLU^3 networks, the statistical error is estimated by Rademacher complexity. We derive the bound on the Rademacher complexity of the non-Lipschitz composition of gradient norm with ReLU^3 network, which is of immense independent interest.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/24/2021

Convergence Rate Analysis for Deep Ritz Method

Using deep neural networks to solve PDEs has attracted a lot of attentio...
research
11/03/2021

Analysis of Deep Ritz Methods for Laplace Equations with Dirichlet Boundary Conditions

Deep Ritz methods (DRM) have been proven numerically to be efficient in ...
research
05/26/2022

Training ReLU networks to high uniform accuracy is intractable

Statistical learning theory provides bounds on the necessary number of t...
research
02/05/2023

Convergence Analysis of the Deep Galerkin Method for Weak Solutions

This paper analyzes the convergence rate of a deep Galerkin method for t...
research
07/30/2021

Error Analysis of Deep Ritz Methods for Elliptic Equations

Using deep neural networks to solve PDEs has attracted a lot of attentio...
research
11/10/2021

Collocation approximation by deep neural ReLU networks for parametric elliptic PDEs with lognormal inputs

We obtained convergence rates of the collocation approximation by deep R...
research
10/13/2021

Machine Learning For Elliptic PDEs: Fast Rate Generalization Bound, Neural Scaling Law and Minimax Optimality

In this paper, we study the statistical limits of deep learning techniqu...

Please sign up or login with your details

Forgot password? Click here to reset