High-dimensional approximation spaces of artificial neural networks and applications to partial differential equations

In this paper we develop a new machinery to study the capacity of artificial neural networks (ANNs) to approximate high-dimensional functions without suffering from the curse of dimensionality. Specifically, we introduce a concept which we refer to as approximation spaces of artificial neural networks and we present several tools to handle those spaces. Roughly speaking, approximation spaces consist of sequences of functions which can, in a suitable way, be approximated by ANNs without curse of dimensionality in the sense that the number of required ANN parameters to approximate a function of the sequence with an accuracy ε > 0 grows at most polynomially both in the reciprocal 1/ε of the required accuracy and in the dimension d ∈ℕ = {1, 2, 3, …} of the function. We show under suitable assumptions that these approximation spaces are closed under various operations including linear combinations, formations of limits, and infinite compositions. To illustrate the power of the machinery proposed in this paper, we employ the developed theory to prove that ANNs have the capacity to overcome the curse of dimensionality in the numerical approximation of certain first order transport partial differential equations (PDEs). Under suitable conditions we even prove that approximation spaces are closed under flows of first order transport PDEs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/20/2019

Uniform error estimates for artificial neural network approximations for heat equations

Recently, artificial neural networks (ANNs) in conjunction with stochast...
research
10/13/2022

Nonlinear approximation of high-dimensional anisotropic analytic functions

Motivated by nonlinear approximation results for classes of parametric p...
research
01/23/2020

Overcoming the curse of dimensionality for approximating Lyapunov functions with deep neural networks under a small-gain condition

We propose a deep neural network architecture for storing approximate Ly...

Please sign up or login with your details

Forgot password? Click here to reset