On quadrature rules for solving Partial Differential Equations using Neural Networks

10/30/2021
by   Jon A. Rivera, et al.
0

Neural Networks have been widely used to solve Partial Differential Equations. These methods require to approximate definite integrals using quadrature rules. Here, we illustrate via 1D numerical examples the quadrature problems that may arise in these applications and propose different alternatives to overcome them, namely: Monte Carlo methods, adaptive integration, polynomial approximations of the Neural Network output, and the inclusion of regularization terms in the loss. We also discuss the advantages and limitations of each proposed alternative. We advocate the use of Monte Carlo methods for high dimensions (above 3 or 4), and adaptive integration or polynomial approximations for low dimensions (3 or below). The use of regularization terms is a mathematically elegant alternative that is valid for any spacial dimension, however, it requires certain regularity assumptions on the solution and complex mathematical analysis when dealing with sophisticated Neural Networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/05/2019

Quasi-Monte Carlo sampling for machine-learning partial differential equations

Solving partial differential equations in high dimensions by deep neural...
research
12/02/2020

Some observations on partial differential equations in Barron and multi-layer spaces

We use explicit representation formulas to show that solutions to certai...
research
04/17/2018

Numerical Integration in Multiple Dimensions with Designed Quadrature

We present a systematic computational framework for generating positive ...
research
07/06/2021

Generalization Error Analysis of Neural networks with Gradient Based Regularization

We study gradient-based regularization methods for neural networks. We m...
research
05/29/2023

Combining Particle and Tensor-network Methods for Partial Differential Equations via Sketching

In this paper, we propose a general framework for solving high-dimension...
research
11/07/2022

A Deep Double Ritz Method (D^2RM) for solving Partial Differential Equations using Neural Networks

Residual minimization is a widely used technique for solving Partial Dif...
research
07/20/2020

Solving the functional Eigen-Problem using Neural Networks

In this work, we explore the ability of NN (Neural Networks) to serve as...

Please sign up or login with your details

Forgot password? Click here to reset