Adaptive Functional Thresholding for Sparse Covariance Function Estimation in High Dimensions

07/14/2022
by   Qin Fang, et al.
0

Covariance function estimation is a fundamental task in multivariate functional data analysis and arises in many applications. In this paper, we consider estimating sparse covariance functions for high-dimensional functional data, where the number of random functions p is comparable to, or even larger than the sample size n. Aided by the Hilbert–Schmidt norm of functions, we introduce a new class of functional thresholding operators that combine functional versions of thresholding and shrinkage, and propose the adaptive functional thresholding estimator by incorporating the variance effects of individual entries of the sample covariance function into functional thresholding. To handle the practical scenario where curves are partially observed with errors, we also develop a nonparametric smoothing approach to obtain the smoothed adaptive functional thresholding estimator and its binned implementation to accelerate the computation. We investigate the theoretical properties of our proposals when p grows exponentially with n under both fully and partially observed functional scenarios. Finally, we demonstrate that the proposed adaptive functional thresholding estimators significantly outperform the competitors through extensive simulations and the functional connectivity analysis of two neuroimaging datasets.

READ FULL TEXT

page 29

page 32

research
06/05/2020

Mean and Covariance Estimation for Functional Snippets

We consider estimation of mean and covariance functions of functional sn...
research
08/25/2021

Depth-based reconstruction method for incomplete functional data

The problem of estimating missing fragments of curves from a functional ...
research
08/29/2020

Low-Rank Covariance Function Estimation for Multidimensional Functional Data

Multidimensional function data arise from many fields nowadays. The cova...
research
11/16/2018

A Novel Approach to Sparse Inverse Covariance Estimation Using Transform Domain Updates and Exponentially Adaptive Thresholding

Sparse Inverse Covariance Estimation (SICE) is useful in many practical ...
research
02/20/2020

Robust M-estimation for Partially Observed Functional Data

Irregular functional data in which densely sampled curves are observed o...
research
09/16/2020

Intrinsic Riemannian Functional Data Analysis for Sparse Longitudinal Observations

A novel framework is developed to intrinsically analyze sparsely observe...
research
06/01/2023

From sparse to dense functional data in high dimensions: Revisiting phase transitions from a non-asymptotic perspective

Nonparametric estimation of the mean and covariance functions is ubiquit...

Please sign up or login with your details

Forgot password? Click here to reset