On the Convergence of the Multi-scale Deep Neural Network (MscaleDNN) in Approximating Oscillatory Functions

12/07/2022
by   Bo Wang, et al.
0

In this paper, we derive diffusion models for the error evolution for a learning algorithm by a multiscale deep neural network (MscaleDNN) <cit.> in approximating oscillatory functions and solutions of boundary value problem of differential equations. The diffusion models in the spectral domain for the error of the MscaleDNN trained by a gradient descent optimization algorithm are obtained when the learning rate goes to zero and the width of network goes to infinity. The diffusion coefficients of the models possess supports covering wider range of frequency as the number of scales used in MscaleDNN increases, compared to that for a normal fully connected neural network. Numerical results of the diffusion models shows faster error decay of the MscaleDNN over a wide frequency range, thus validating the advantages of using the MscaleDNN in the approximating highly oscillated functions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/23/2019

A Phase Shift Deep Neural Network for High Frequency Wave Equations in Inhomogeneous Media

In this paper, we propose a phase shift deep neural network (PhaseDNN) w...
research
01/30/2023

Deep learning numerical methods for high-dimensional fully nonlinear PIDEs and coupled FBSDEs with jumps

We propose a deep learning algorithm for solving high-dimensional parabo...
research
06/08/2018

A Deep Neural Network Surrogate for High-Dimensional Random Partial Differential Equations

Developing efficient numerical algorithms for high dimensional random Pa...
research
09/27/2020

Multi-scale Deep Neural Network (MscaleDNN) Methods for Oscillatory Stokes Flows in Complex Domains

In this paper, we study a multi-scale deep neural network (MscaleDNN) as...
research
05/03/2019

PhaseDNN - A Parallel Phase Shift Deep Neural Network for Adaptive Wideband Learning

In this paper, we propose a phase shift deep neural network (PhaseDNN) w...
research
01/07/2023

Investigations on convergence behaviour of Physics Informed Neural Networks across spectral ranges and derivative orders

An important inference from Neural Tangent Kernel (NTK) theory is the ex...
research
07/22/2020

Multi-scale Deep Neural Network (MscaleDNN) for Solving Poisson-Boltzmann Equation in Complex Domains

In this paper, we propose novel multi-scale DNNs (MscaleDNN) using the i...

Please sign up or login with your details

Forgot password? Click here to reset