Active Learning Based Sampling for High-Dimensional Nonlinear Partial Differential Equations

12/28/2021
by   Wenhan Gao, et al.
0

The deep-learning-based least squares method has shown successful results in solving high-dimensional non-linear partial differential equations (PDEs). However, this method usually converges slowly. To speed up the convergence of this approach, an active-learning-based sampling algorithm is proposed in this paper. This algorithm actively chooses the most informative training samples from a probability density function based on residual errors to facilitate error reduction. In particular, points with larger residual errors will have more chances of being selected for training. This algorithm imitates the human learning process: learners are likely to spend more time repeatedly studying mistakes than other tasks they have correctly finished. A series of numerical results are illustrated to demonstrate the effectiveness of our active-learning-based sampling in high dimensions to speed up the convergence of the deep-learning-based least squares method.

READ FULL TEXT

page 6

page 10

page 13

page 15

research
01/14/2020

SelectNet: Self-paced Learning for High-dimensional Partial Differential Equations

The residual method with deep neural networks as function parametrizatio...
research
11/03/2018

Convergence of the Deep BSDE Method for Coupled FBSDEs

The recently proposed numerical algorithm, deep BSDE method, has shown r...
research
08/24/2020

Active learning of deep surrogates for PDEs: Application to metasurface design

Surrogate models for partial-differential equations are widely used in t...
research
10/24/2022

Active Learning for Single Neuron Models with Lipschitz Non-Linearities

We consider the problem of active learning for single neuron models, als...
research
03/02/2022

Neural Galerkin Scheme with Active Learning for High-Dimensional Evolution Equations

Machine learning methods have been shown to give accurate predictions in...
research
06/27/2023

Coupling parameter and particle dynamics for adaptive sampling in Neural Galerkin schemes

Training nonlinear parametrizations such as deep neural networks to nume...
research
10/14/2022

Gibbs Sampling of Periodic Potentials on a Quantum Computer

Motivated by applications in machine learning, we present a quantum algo...

Please sign up or login with your details

Forgot password? Click here to reset