Estimation of a regression function on a manifold by fully connected deep neural networks

07/20/2021
by   Michael Kohler, et al.
0

Estimation of a regression function from independent and identically distributed data is considered. The L_2 error with integration with respect to the distribution of the predictor variable is used as the error criterion. The rate of convergence of least squares estimates based on fully connected spaces of deep neural networks with ReLU activation function is analyzed for smooth regression functions. It is shown that in case that the distribution of the predictor variable is concentrated on a manifold, these estimates achieve a rate of convergence which depends on the dimension of the manifold and not on the number of components of the predictor variable.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/04/2022

Analysis of the rate of convergence of an over-parametrized deep neural network estimate learned by gradient descent

Estimation of a regression function from independent and identically dis...
research
08/29/2019

On the rate of convergence of fully connected very deep neural network regression estimates

Recent results in nonparametric regression show that deep learning, i.e....
research
08/26/2022

Multivariate manifold-valued curve regression in time

Fréchet global regression is extended to the context of bivariate curve ...
research
12/09/2019

Over-parametrized deep neural networks do not generalize well

Recently it was shown in several papers that backpropagation is able to ...
research
09/26/2018

Deep Neural Networks for Estimation and Inference: Application to Causal Effects and Other Semiparametric Estimands

We study deep neural networks and their use in semiparametric inference....
research
09/24/2015

Provable approximation properties for deep neural networks

We discuss approximation of functions using deep neural nets. Given a fu...
research
07/15/2020

Measurement error models: from nonparametric methods to deep neural networks

The success of deep learning has inspired recent interests in applying n...

Please sign up or login with your details

Forgot password? Click here to reset