Phase transitions in spiked matrix estimation: information-theoretic analysis

06/12/2018
by   Léo Miolane, et al.
0

We study here the so-called spiked Wigner and Wishart models, where one observes a low-rank matrix perturbed by some Gaussian noise. These models encompass many classical statistical tasks such as sparse PCA, submatrix localization, community detection or Gaussian mixture clustering. The goal of these notes is to present in a unified manner recent results (as well as new developments) on the information-theoretic limits of these spiked matrix/tensor models. We compute the minimal mean squared error for the estimation of the low-rank signal and compare it to the performance of spectral estimators and message passing algorithms. Phase transition phenomena are observed: depending on the noise level it is either impossible, easy (i.e. using polynomial-time estimators) or hard (information-theoretically possible, but no efficient algorithm is known to succeed) to recover the signal.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/13/2023

Optimal Algorithms for the Inhomogeneous Spiked Wigner Model

In this paper, we study a spiked Wigner problem with an inhomogeneous no...
research
06/22/2021

Rank-one matrix estimation with groupwise heteroskedasticity

We study the problem of estimating a rank-one matrix from Gaussian obser...
research
05/15/2018

On the glassy nature of the hard phase in inference problems

An algorithmically hard phase was described in a range of inference prob...
research
12/06/2018

Rank-one matrix estimation: analysis of algorithmic and information theoretic limits by the spatial coupling method

Factorizing low-rank matrices is a problem with many applications in mac...
research
03/01/2015

Phase Transitions in Sparse PCA

We study optimal estimation for sparse principal component analysis when...
research
01/22/2022

Optimal Estimation and Computational Limit of Low-rank Gaussian Mixtures

Structural matrix-variate observations routinely arise in diverse fields...
research
07/11/2022

Optimal Clustering by Lloyd Algorithm for Low-Rank Mixture Model

This paper investigates the computational and statistical limits in clus...

Please sign up or login with your details

Forgot password? Click here to reset