An efficient greedy training algorithm for neural networks and applications in PDEs

07/09/2021
by   Wenrui Hao, et al.
0

Recently, neural networks have been widely applied for solving partial differential equations. However, the resulting optimization problem brings many challenges for current training algorithms. This manifests itself in the fact that the convergence order that has been proven theoretically cannot be obtained numerically. In this paper, we develop a novel greedy training algorithm for solving PDEs which builds the neural network architecture adaptively. It is the first training algorithm that observes the convergence order of neural networks numerically. This innovative algorithm is tested on several benchmark examples in both 1D and 2D to confirm its efficiency and robustness.

READ FULL TEXT
research
07/21/2022

Unsupervised Legendre-Galerkin Neural Network for Stiff Partial Differential Equations

Machine learning methods have been lately used to solve differential equ...
research
10/31/2020

Convergence analysis of neural networks for solving a free boundary system

Free boundary problems deal with systems of partial differential equatio...
research
01/22/2021

Sobolev Training for the Neural Network Solutions of PDEs

Approximating the numerical solutions of Partial Differential Equations ...
research
07/23/2023

Tackling the Curse of Dimensionality with Physics-Informed Neural Networks

The curse-of-dimensionality (CoD) taxes computational resources heavily ...
research
01/20/2021

Quadratic Residual Networks: A New Class of Neural Networks for Solving Forward and Inverse Problems in Physics Involving PDEs

We propose quadratic residual networks (QRes) as a new type of parameter...
research
12/09/2019

Deep Ritz revisited

Recently, progress has been made in the application of neural networks t...
research
06/14/2021

Random feature neural networks learn Black-Scholes type PDEs without curse of dimensionality

This article investigates the use of random feature neural networks for ...

Please sign up or login with your details

Forgot password? Click here to reset