Detection problems in the spiked matrix models

01/12/2023
by   Ji Hyung Jung, et al.
8

We study the statistical decision process of detecting the low-rank signal from various signal-plus-noise type data matrices, known as the spiked random matrix models. We first show that the principal component analysis can be improved by entrywise pre-transforming the data matrix if the noise is non-Gaussian, generalizing the known results for the spiked random matrix models with rank-1 signals. As an intermediate step, we find out sharp phase transition thresholds for the extreme eigenvalues of spiked random matrices, which generalize the Baik-Ben Arous-Péché (BBP) transition. We also prove the central limit theorem for the linear spectral statistics for the spiked random matrices and propose a hypothesis test based on it, which does not depend on the distribution of the signal or the noise. When the noise is non-Gaussian noise, the test can be improved with an entrywise transformation to the data matrix with additive noise. We also introduce an algorithm that estimates the rank of the signal when it is not known a priori.

READ FULL TEXT

page 26

page 31

page 32

research
04/28/2021

Detection of Signal in the Spiked Rectangular Models

We consider the problem of detecting signals in the rank-one signal-plus...
research
09/25/2020

Tracy-Widom law for the extreme eigenvalues of large signal-plus-noise matrices

Let =+ be an M× N matrix, where is a rectangular diagonal matrix and c...
research
02/01/2018

Signal-plus-noise matrix models: eigenvector deviations and fluctuations

Estimating eigenvectors and low-dimensional subspaces is of central impo...
research
09/19/2016

Optimality and Sub-optimality of PCA for Spiked Random Matrices and Synchronization

A central problem of random matrix theory is to understand the eigenvalu...
research
04/14/2021

Detection of a rank-one signal with limited training data

In this paper, we reconsider the problem of detecting a matrix-valued ra...
research
07/02/2018

Optimality and Sub-optimality of PCA I: Spiked Random Matrix Models

A central problem of random matrix theory is to understand the eigenvalu...
research
03/19/2022

Perturbation Analysis of Randomized SVD and its Applications to High-dimensional Statistics

Randomized singular value decomposition (RSVD) is a class of computation...

Please sign up or login with your details

Forgot password? Click here to reset