From sparse to dense functional data in high dimensions: Revisiting phase transitions from a non-asymptotic perspective

06/01/2023
by   Shaojun Guo, et al.
0

Nonparametric estimation of the mean and covariance functions is ubiquitous in functional data analysis and local linear smoothing techniques are most frequently used. Zhang and Wang (2016) explored different types of asymptotic properties of the estimation, which reveal interesting phase transition phenomena based on the relative order of the average sampling frequency per subject T to the number of subjects n, partitioning the data into three categories: “sparse”, “semi-dense” and “ultra-dense”. In an increasingly available high-dimensional scenario, where the number of functional variables p is large in relation to n, we revisit this open problem from a non-asymptotic perspective by deriving comprehensive concentration inequalities for the local linear smoothers. Besides being of interest by themselves, our non-asymptotic results lead to elementwise maximum rates of L_2 convergence and uniform convergence serving as a fundamentally important tool for further convergence analysis when p grows exponentially with n and possibly T. With the presence of extra log p terms to account for the high-dimensional effect, we then investigate the scaled phase transitions and the corresponding elementwise maximum rates from sparse to semi-dense to ultra-dense functional data in high dimensions. Finally, numerical studies are carried out to confirm our established theoretical properties.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/03/2020

Unified statistical inference for a novel nonlinear dynamic functional/longitudinal data model

In light of recent work studying massive functional/longitudinal data, s...
research
03/10/2015

Minimax Optimal Rates of Estimation in High Dimensional Additive Models: Universal Phase Transition

We establish minimax optimal rates of convergence for estimation in a hi...
research
07/14/2022

Adaptive Functional Thresholding for Sparse Covariance Function Estimation in High Dimensions

Covariance function estimation is a fundamental task in multivariate fun...
research
10/27/2021

Nonparametric Estimation for SDE with Sparsely Sampled Paths: an FDA Perspective

We consider the problem of nonparametric estimation of the drift and dif...
research
03/23/2020

On Consistency and Sparsity for High-Dimensional Functional Time Series with Application to Autoregressions

Modelling a large collection of functional time series arises in a broad...
research
05/11/2016

Asymptotic equivalence of regularization methods in thresholded parameter space

High-dimensional data analysis has motivated a spectrum of regularizatio...
research
10/22/2017

On the rates of convergence of Parallelized Averaged Stochastic Gradient Algorithms

The growing interest for high dimensional and functional data analysis l...

Please sign up or login with your details

Forgot password? Click here to reset