Inference for linear forms of eigenvectors under minimal eigenvalue separation: Asymmetry and heteroscedasticity

01/14/2020
by   Chen Cheng, et al.
10

A fundamental task that spans numerous applications is inference and uncertainty quantification for linear functionals of the eigenvectors of an unknown low-rank matrix. We prove that this task can be accomplished in a setting where the true matrix is symmetric and the additive noise matrix contains independent (and non-symmetric) entries. Specifically, we develop algorithms that produce confidence intervals for linear forms of individual eigenvectors, based on eigen-decomposition of the asymmetric data matrix followed by a careful de-biasing scheme. The proposed procedures and the accompanying theory enjoy several important features: (1) distribution-free (i.e. prior knowledge about the noise distributions is not needed); (2) adaptive to heteroscedastic noise; (3) statistically optimal under Gaussian noise. Along the way, we establish procedures to construct optimal confidence intervals for the eigenvalues of interest. All this happens under minimal eigenvalue separation, a condition that goes far beyond what generic matrix perturbation theory has to offer. Our studies fall under the category of "fine-grained" functional inference in low-complexity models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/04/2023

Distributional Theory and Statistical Inference for Linear Functions of Eigenvectors with Small Eigengaps

Spectral methods have myriad applications in high-dimensional statistics...
research
11/30/2018

Asymmetry Helps: Eigenvalue and Eigenvector Analyses of Asymmetrically Perturbed Low-Rank Matrices

This paper is concerned with a curious phenomenon in spectral estimation...
research
06/15/2020

Uncertainty quantification for nonconvex tensor completion: Confidence intervals, heteroscedasticity and optimality

We study the distribution and uncertainty of nonconvex optimization for ...
research
08/31/2019

Statistical Inferences of Linear Forms for Noisy Matrix Completion

We introduce a flexible framework for making inferences about general li...
research
03/31/2023

Inference on eigenvectors of non-symmetric matrices

This paper argues that the symmetrisability condition in Tyler (1981) is...
research
11/01/2021

Uncertainty quantification for wide-bin unfolding: one-at-a-time strict bounds and prior-optimized confidence intervals

Unfolding is an ill-posed inverse problem in particle physics aiming to ...
research
07/29/2019

Subsampling Sparse Graphons Under Minimal Assumptions

We establish a general theory for subsampling network data generated by ...

Please sign up or login with your details

Forgot password? Click here to reset