Bridging Traditional and Machine Learning-based Algorithms for Solving PDEs: The Random Feature Method

07/27/2022
by   Jingrun Chen, et al.
0

One of the oldest and most studied subject in scientific computing is algorithms for solving partial differential equations (PDEs). A long list of numerical methods have been proposed and successfully used for various applications. In recent years, deep learning methods have shown their superiority for high-dimensional PDEs where traditional methods fail. However, for low dimensional problems, it remains unclear whether these methods have a real advantage over traditional algorithms as a direct solver. In this work, we propose the random feature method (RFM) for solving PDEs, a natural bridge between traditional and machine learning-based algorithms. RFM is based on a combination of well-known ideas: 1. representation of the approximate solution using random feature functions; 2. collocation method to take care of the PDE; 3. the penalty method to treat the boundary conditions, which allows us to treat the boundary condition and the PDE in the same footing. We find it crucial to add several additional components including multi-scale representation and rescaling the weights in the loss function. We demonstrate that the method exhibits spectral accuracy and can compete with traditional solvers in terms of both accuracy and efficiency. In addition, we find that RFM is particularly suited for complex problems with complex geometry, where both traditional and machine learning-based algorithms encounter difficulties.

READ FULL TEXT

page 12

page 14

page 15

page 16

page 17

page 21

research
09/08/2020

Neural Time-Dependent Partial Differential Equation

Partial differential equations (PDEs) play a crucial role in studying a ...
research
10/07/2021

A composable autoencoder-based iterative algorithm for accelerating numerical simulations

Numerical simulations for engineering applications solve partial differe...
research
02/25/2019

Learning to Optimize Multigrid PDE Solvers

Constructing fast numerical solvers for partial differential equations (...
research
06/02/2022

Stochastic Deep-Ritz for Parametric Uncertainty Quantification

Scientific machine learning has become an increasingly popular tool for ...
research
02/04/2021

A Deep Collocation Method for the Bending Analysis of Kirchhoff Plate

In this paper, a deep collocation method (DCM) for thin plate bending pr...
research
10/11/2022

A composable machine-learning approach for steady-state simulations on high-resolution grids

In this paper we show that our Machine Learning (ML) approach, CoMLSim (...

Please sign up or login with your details

Forgot password? Click here to reset