Optimal shrinkage of singular values under high-dimensional noise with separable covariance structure

07/07/2022
by   Pei-Chun Su, et al.
0

We consider an optimal shrinkage algorithm that depends on an effective rank estimation and imputation, coined optimal shrinkage with imputation and rank estimation (OSIR), for matrix denoising in the presence of high-dimensional noise with the separable covariance structure (colored and dependent noise). The algorithm does not depend on estimating separable covariance structure of the noise. On the theoretical side, we study the asymptotic behavior of outlier singular values and singular vectors and prove the delocalization of the non-outlier singular vectors of the associated random matrix with a convergence rate, and apply these results to analyze OSIR over different signal strengths and sizes of data matrices. On the application side, we carry out simulations to demonstrate the effectiveness of OSIR, and apply it to study the fetal electrocardiogram signal processing challenge and the two-dimensional random tomography problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/27/2018

Singular vector and singular subspace distribution for the matrix denoising model

In this paper, we study the matrix denosing model Y=S+X, where S is a lo...
research
11/06/2018

Optimal singular value shrinkage with noise homogenization

We derive the optimal singular values for prediction in the spiked model...
research
05/27/2021

Entrywise Estimation of Singular Vectors of Low-Rank Matrices with Heteroskedasticity and Dependence

We propose an estimator for the singular vectors of high-dimensional low...
research
03/30/2020

Regularization in High-Dimensional Regression and Classification via Random Matrix Theory

We study general singular value shrinkage estimators in high-dimensional...
research
05/16/2022

GraphSPME: Markov Precision Matrix Estimation and Asymptotic Stein-Type Shrinkage

GraphSPME is an open source Python, R and C++ header-only package implem...
research
11/02/2022

Matrix Denoising with Partial Noise Statistics: Optimal Singular Value Shrinkage of Spiked F-Matrices

We study the problem of estimating a large, low-rank matrix corrupted by...
research
09/25/2020

ScreeNOT: Exact MSE-Optimal Singular Value Thresholding in Correlated Noise

We derive a formula for optimal hard thresholding of the singular value ...

Please sign up or login with your details

Forgot password? Click here to reset