Spectral Barron space and deep neural network approximation

09/02/2023
by   Yulei Liao, et al.
0

We prove the sharp embedding between the spectral Barron space and the Besov space. Given the spectral Barron space as the target function space, we prove a dimension-free result that if the neural network contains L hidden layers with N units per layer, then the upper and lower bounds of the L^2-approximation error are 𝒪(N^-sL) with 0 < sL≤ 1/2, where s is the smoothness index of the spectral Barron space.

READ FULL TEXT
research
01/25/2022

A Regularity Theory for Static Schrödinger Equations on ℝ^d in Spectral Barron Spaces

Spectral Barron spaces have received considerable interest recently as i...
research
05/30/2023

Embedding Inequalities for Barron-type Spaces

One of the fundamental problems in deep learning theory is understanding...
research
02/10/2023

On Abstract Spectral Constants

We prove bounds for a class of unital homomorphisms arising in the study...
research
05/29/2020

Machine learning in spectral domain

Deep neural networks are usually trained in the space of the nodes, by a...
research
06/12/2019

Evaluation of Dataflow through layers of Deep Neural Networks in Classification and Regression Problems

This paper introduces two straightforward, effective indices to evaluate...
research
06/06/2018

The effect of the choice of neural network depth and breadth on the size of its hypothesis space

We show that the number of unique function mappings in a neural network ...
research
08/18/2022

Quantitative Universal Approximation Bounds for Deep Belief Networks

We show that deep belief networks with binary hidden units can approxima...

Please sign up or login with your details

Forgot password? Click here to reset