Information-theoretic limits of a multiview low-rank symmetric spiked matrix model

05/16/2020
by   Jean Barbier, et al.
0

We consider a generalization of an important class of high-dimensional inference problems, namely spiked symmetric matrix models, often used as probabilistic models for principal component analysis. Such paradigmatic models have recently attracted a lot of attention from a number of communities due to their phenomenological richness with statistical-to-computational gaps, while remaining tractable. We rigorously establish the information-theoretic limits through the proof of single-letter formulas for the mutual information and minimum mean-square error. On a technical side we improve the recently introduced adaptive interpolation method, so that it can be used to study low-rank models (i.e., estimation problems of "tall matrices") in full generality, an important step towards the rigorous analysis of more complicated inference and learning models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/22/2020

Information-Theoretic Limits for the Matrix Tensor Product

This paper studies a high-dimensional inference problem involving the ma...
research
04/09/2019

Mutual Information for Low-Rank Even-Order Symmetric Tensor Factorization

We consider a statistical model for finite-rank symmetric tensor factori...
research
07/15/2019

Concentration of the matrix-valued minimum mean-square error in optimal Bayesian inference

We consider Bayesian inference of signals with vector-valued entries. Ex...
research
09/14/2021

Statistical limits of dictionary learning: random matrix theory and the spectral replica method

We consider increasingly complex models of matrix denoising and dictiona...
research
12/06/2018

Rank-one matrix estimation: analysis of algorithmic and information theoretic limits by the spatial coupling method

Factorizing low-rank matrices is a problem with many applications in mac...
research
01/05/2018

Estimation in the Spiked Wigner Model: A Short Proof of the Replica Formula

We consider the problem of estimating the rank-one perturbation of a Wig...
research
06/13/2018

Adaptive Path Interpolation for Sparse Systems: Application to a Simple Censored Block Model

A new adaptive path interpolation method has been recently developed as ...

Please sign up or login with your details

Forgot password? Click here to reset