Numerical Solution of the Parametric Diffusion Equation by Deep Neural Networks

04/25/2020
by   Moritz Geist, et al.
0

We perform a comprehensive numerical study of the effect of approximation-theoretical results for neural networks on practical learning problems in the context of numerical analysis. As the underlying model, we study the machine-learning-based solution of parametric partial differential equations. Here, approximation theory predicts that the performance of the model should depend only very mildly on the dimension of the parameter space and is determined by the intrinsic dimension of the solution manifold of the parametric partial differential equation. We use various methods to establish comparability between test-cases by minimizing the effect of the choice of test-cases on the optimization and sampling aspects of the learning problem. We find strong support for the hypothesis that approximation-theoretical effects heavily influence the practical behavior of learning problems in numerical analysis.

READ FULL TEXT

page 13

page 17

page 18

research
03/31/2019

A Theoretical Analysis of Deep Neural Networks and Parametric PDEs

We derive upper bounds on the complexity of ReLU neural networks approxi...
research
03/14/2022

Solving parametric partial differential equations with deep rectified quadratic unit neural networks

Implementing deep neural networks for learning the solution maps of para...
research
03/03/2021

Partial differential equation solver based on optimization methods

The numerical solution methods for partial differential equation (PDE) s...
research
04/04/2021

Tukey Depths and Hamilton-Jacobi Differential Equations

The widespread application of modern machine learning has increased the ...
research
12/14/2021

Learn bifurcations of nonlinear parametric systems via equation-driven neural networks

Nonlinear parametric systems have been widely used in modeling nonlinear...
research
01/17/2023

Operator Learning Framework for Digital Twin and Complex Engineering Systems

With modern computational advancements and statistical analysis methods,...

Please sign up or login with your details

Forgot password? Click here to reset