DAS: A deep adaptive sampling method for solving partial differential equations

12/28/2021
by   Kejun Tang, et al.
17

In this work we propose a deep adaptive sampling (DAS) method for solving partial differential equations (PDEs), where deep neural networks are utilized to approximate the solutions of PDEs and deep generative models are employed to generate new collocation points that refine the training set. The overall procedure of DAS consists of two components: solving the PDEs by minimizing the residual loss on the collocation points in the training set and generating a new training set to further improve the accuracy of current approximate solution. In particular, we treat the residual as a probability density function and approximate it with a deep generative model, called KRnet. The new samples from KRnet are consistent with the distribution induced by the residual, i.e., more samples are located in the region of large residual and less samples are located in the region of small residual. Analogous to classical adaptive methods such as the adaptive finite element, KRnet acts as an error indicator that guides the refinement of the training set. Compared to the neural network approximation obtained with uniformly distributed collocation points, the developed algorithms can significantly improve the accuracy, especially for low regularity and high-dimensional problems. We present a theoretical analysis to show that the proposed DAS method can reduce the error bound and demonstrate its effectiveness with numerical experiments.

READ FULL TEXT

page 16

page 18

page 19

page 21

page 22

research
05/30/2023

Adversarial Adaptive Sampling: Unify PINN and Optimal Transport for the Approximation of PDEs

Solving partial differential equations (PDEs) is a central task in scien...
research
03/28/2023

Adaptive trajectories sampling for solving PDEs with deep learning methods

In this paper, we propose a new adaptive technique, named adaptive traje...
research
10/01/2022

Failure-informed adaptive sampling for PINNs

Physics-informed neural networks (PINNs) have emerged as an effective te...
research
01/14/2020

SelectNet: Self-paced Learning for High-dimensional Partial Differential Equations

The residual method with deep neural networks as function parametrizatio...
research
03/28/2023

GAS: A Gaussian Mixture Distribution-Based Adaptive Sampling Method for PINNs

With recent study of the deep learning in scientific computation, the PI...
research
04/03/2022

Implicit-Explicit Error Indicator based on Approximation Order

With the immense computing power at our disposal, the numerical solution...
research
06/27/2023

Coupling parameter and particle dynamics for adaptive sampling in Neural Galerkin schemes

Training nonlinear parametrizations such as deep neural networks to nume...

Please sign up or login with your details

Forgot password? Click here to reset