Optimal estimation of functionals of high-dimensional mean and covariance matrix

08/20/2019
by   Jianqing Fan, et al.
0

Motivated by portfolio allocation and linear discriminant analysis, we consider estimating a functional μΣ^-1μ involving both the mean vector μ and covariance matrix Σ. We study the minimax estimation of the functional in the high-dimensional setting where Σ^-1μ is sparse. Akin to past works on functional estimation, we show that the optimal rate for estimating the functional undergoes a phase transition between regular parametric rate and some form of high-dimensional estimation rate. We further show that the optimal rate is attained by a carefully designed plug-in estimator based on de-biasing, while a family of naive plug-in estimators are proved to fall short. We further generalize the estimation problem and techniques that allow robust inputs of mean and covariance matrix estimators. Extensive numerical experiments lend further supports to our theoretical results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/28/2022

High dimensional discriminant rules with shrinkage estimators of covariance matrix and mean vector

Linear discriminant analysis is a typical method used in the case of lar...
research
05/23/2014

Convex Banding of the Covariance Matrix

We introduce a new sparse estimator of the covariance matrix for high-di...
research
08/29/2019

Minimax optimal estimators for general additive functional estimation

In this paper, we observe a sparse mean vector through Gaussian noise an...
research
02/25/2022

High-Dimensional Sparse Bayesian Learning without Covariance Matrices

Sparse Bayesian learning (SBL) is a powerful framework for tackling the ...
research
04/09/2018

High-dimensional Linear Discriminant Analysis: Optimality, Adaptive Algorithm, and Missing Data

This paper aims to develop an optimality theory for linear discriminant ...
research
01/11/2022

Estimation and Inference with Proxy Data and its Genetic Applications

Existing high-dimensional statistical methods are largely established fo...
research
06/01/2023

Robust covariance estimation with missing values and cell-wise contamination

Large datasets are often affected by cell-wise outliers in the form of m...

Please sign up or login with your details

Forgot password? Click here to reset