An exact sinΘ formula for matrix perturbation analysis and its applications

11/16/2020
by   He Lyu, et al.
0

Singular vector perturbation is an important topic in numerical analysis and statistics. The main goal of this paper is to provide a useful tool to tackle matrix perturbation problems. Explicitly, we establish a useful formula for the sinΘ angles between the perturbed and the original singular subspaces. This formula is expressed in terms of the perturbation matrix and therefore characterizes how the singular vector perturbation is induced by the additive noise. We then use this formula to derive a one-sided version of the sinΘ theorem, as well as improve the bound on the ℓ_2,∞ norm of the singular vector perturbation error. Following this, we proceed to show that two other popular stability problems (i.e., the stability of the Principal Component Analysis and the stability of the singular value thresholding operator) can be solved with the help of these new results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/16/2020

Perturbation expansions and error bounds for the truncated singular value decomposition

Truncated singular value decomposition is a reduced version of the singu...
research
08/04/2020

A Schatten-q Matrix Perturbation Theory via Perturbation Projection Error Bound

This paper studies the Schatten-q error of low-rank matrix estimation by...
research
04/03/2018

Feature selection in weakly coherent matrices

A problem of paramount importance in both pure (Restricted Invertibility...
research
05/30/2022

Leave-one-out Singular Subspace Perturbation Analysis for Spectral Clustering

The singular subspaces perturbation theory is of fundamental importance ...
research
09/23/2021

A note on perturbation analysis for T-product based tensor singular values

In this note, we present perturbation analysis for the T-product based t...
research
12/15/2020

Spectral Methods for Data Science: A Statistical Perspective

Spectral methods have emerged as a simple yet surprisingly effective app...
research
09/25/2020

ScreeNOT: Exact MSE-Optimal Singular Value Thresholding in Correlated Noise

We derive a formula for optimal hard thresholding of the singular value ...

Please sign up or login with your details

Forgot password? Click here to reset