Convergence analysis of unsupervised Legendre-Galerkin neural networks for linear second-order elliptic PDEs

11/16/2022
by   Seungchan Ko, et al.
0

In this paper, we perform the convergence analysis of unsupervised Legendre–Galerkin neural networks (ULGNet), a deep-learning-based numerical method for solving partial differential equations (PDEs). Unlike existing deep learning-based numerical methods for PDEs, the ULGNet expresses the solution as a spectral expansion with respect to the Legendre basis and predicts the coefficients with deep neural networks by solving a variational residual minimization problem. Since the corresponding loss function is equivalent to the residual induced by the linear algebraic system depending on the choice of basis functions, we prove that the minimizer of the discrete loss function converges to the weak solution of the PDEs. Numerical evidence will also be provided to support the theoretical result. Key technical tools include the variant of the universal approximation theorem for bounded neural networks, the analysis of the stiffness and mass matrices, and the uniform law of large numbers in terms of the Rademacher complexity.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/05/2019

Deep least-squares methods: an unsupervised learning-based numerical method for solving elliptic PDEs

This paper studies an unsupervised deep learning-based numerical approac...
research
09/01/2023

Solving multiscale elliptic problems by sparse radial basis function neural networks

Machine learning has been successfully applied to various fields of scie...
research
05/10/2022

Deep Learning-based Schemes for Singularly Perturbed Convection-Diffusion Problems

Deep learning-based numerical schemes such as Physically Informed Neural...
research
04/18/2022

A Deep Learning Galerkin Method for the Closed-Loop Geothermal System

There has been an arising trend of adopting deep learning methods to stu...
research
12/09/2019

Deep Ritz revisited

Recently, progress has been made in the application of neural networks t...
research
05/16/2023

Deep Fourier Residual method for solving time-harmonic Maxwell's equations

Solving PDEs with machine learning techniques has become a popular alter...
research
02/19/2020

Implicit bias with Ritz-Galerkin method in understanding deep learning for solving PDEs

This paper aims at studying the difference between Ritz-Galerkin (R-G) m...

Please sign up or login with your details

Forgot password? Click here to reset