Convergence analysis of a quasi-Monte Carlo-based deep learning algorithm for solving partial differential equations

10/28/2022
by   Fengjiang Fu, et al.
0

Deep learning methods have achieved great success in solving partial differential equations (PDEs), where the loss is often defined as an integral. The accuracy and efficiency of these algorithms depend greatly on the quadrature method. We propose to apply quasi-Monte Carlo (QMC) methods to the Deep Ritz Method (DRM) for solving the Neumann problems for the Poisson equation and the static Schrödinger equation. For error estimation, we decompose the error of using the deep learning algorithm to solve PDEs into the generalization error, the approximation error and the training error. We establish the upper bounds and prove that QMC-based DRM achieves an asymptotically smaller error bound than DRM. Numerical experiments show that the proposed method converges faster in all cases and the variances of the gradient estimators of randomized QMC-based DRM are much smaller than those of DRM, which illustrates the superiority of QMC in deep learning over MC.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/05/2019

Quasi-Monte Carlo sampling for machine-learning partial differential equations

Solving partial differential equations in high dimensions by deep neural...
research
08/01/2023

Learning Green's Function Efficiently Using Low-Rank Approximations

Learning the Green's function using deep learning models enables to solv...
research
03/07/2022

A deep branching solver for fully nonlinear partial differential equations

We present a multidimensional deep learning implementation of a stochast...
research
06/21/2022

Robust SDE-Based Variational Formulations for Solving Linear PDEs via Deep Learning

The combination of Monte Carlo methods and deep learning has recently le...
research
08/03/2019

A hierarchical neural hybrid method for failure probability estimation

Failure probability evaluation for complex physical and engineering syst...
research
05/10/2023

A Generalizable Physics-informed Learning Framework for Risk Probability Estimation

Accurate estimates of long-term risk probabilities and their gradients a...
research
09/30/2019

Full error analysis for the training of deep neural networks

Deep learning algorithms have been applied very successfully in recent y...

Please sign up or login with your details

Forgot password? Click here to reset