Nonparametric regression for repeated measurements with deep neural networks

02/27/2023
by   Shunxing Yan, et al.
0

Analysis of repeated measurements for a sample of subjects has been intensively studied with several important branches developed, including longitudinal/panel/functional data analysis, while nonparametric regression of the mean function serves as a cornerstone that many statistical models are built upon. In this work, we investigate this problem using fully connected deep neural network (DNN) estimators with flexible shapes. A comprehensive theoretical framework is established by adopting empirical process techniques to tackle clustered dependence. We then derive the nearly optimal convergence rate of the DNN estimators in Hölder smoothness space, and illustrate the phase transition phenomenon inherent to repeated measurements and its connection to the curse of dimensionality. Furthermore, we study the function spaces with low intrinsic dimensions, including the hierarchical composition model, anisotropic Hölder smoothness and low-dimensional support set, and also obtain new approximation results and matching lower bounds to demonstrate the adaptivity of the DNN estimators for circumventing the curse of dimensionality.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/20/2022

How do noise tails impact on deep ReLU networks?

This paper investigates the stability of deep ReLU neural networks for n...
research
10/28/2019

Deep learning is adaptive to intrinsic dimensionality of model smoothness in anisotropic Besov space

Deep learning has exhibited superior performance for various tasks, espe...
research
07/10/2021

Deep Quantile Regression: Mitigating the Curse of Dimensionality Through Composition

This paper considers the problem of nonparametric quantile regression un...
research
04/17/2023

Deep Neural Network Approximation of Composition Functions: with application to PINNs

In this paper, we focus on approximating a natural class of functions th...
research
07/06/2022

Adaptive deep learning for nonparametric time series regression

In this paper, we develop a general theory for adaptive nonparametric es...
research
10/18/2018

Adaptivity of deep ReLU network for learning in Besov and mixed smooth Besov spaces: optimal rate and curse of dimensionality

Deep learning has shown high performances in various types of tasks from...
research
07/19/2023

Repeated Observations for Classification

We study the problem nonparametric classification with repeated observat...

Please sign up or login with your details

Forgot password? Click here to reset