Estimation in the Spiked Wigner Model: A Short Proof of the Replica Formula

01/05/2018
by   Ahmed El Alaoui, et al.
0

We consider the problem of estimating the rank-one perturbation of a Wigner matrix in a setting of low signal-to-noise ratio. This serves as a simple model for principal component analysis in high dimensions. The mutual information per variable between the spike and the observed matrix, or equivalently, the normalized Kullback-Leibler divergence between the planted and null models are known to converge to the so-called replica-symmetric formula, the properties of which determine the fundamental limits of estimation in this model. We provide in this note a short and transparent proof of this formula, based on simple executions of Gaussian interpolations and standard concentration-of-measure arguments. The Franz-Parisi potential, that is, the free entropy at a fixed overlap, plays an important role in our proof. Our proof can be generalized straightforwardly to spiked tensor models of even order.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/04/2014

A statistical model for tensor PCA

We consider the Principal Component Analysis problem for large tensors o...
research
06/26/2020

Tensor estimation with structured priors

We consider rank-one symmetric tensor estimation when the tensor is corr...
research
05/30/2020

An Analytical Formula for Spectrum Reconstruction

We study the spectrum reconstruction technique. As is known to all, eige...
research
08/02/2018

Algorithmic thresholds for tensor PCA

We study the algorithmic thresholds for principal component analysis of ...
research
05/16/2020

Information-theoretic limits of a multiview low-rank symmetric spiked matrix model

We consider a generalization of an important class of high-dimensional i...
research
06/25/2019

A note on Bianchi-Donà's proof to the variance formula of von Neumann entropy

Bianchi and Donà [1] have recently reported a proof to the variance form...
research
06/25/2018

Fundamental limits of detection in the spiked Wigner model

We study the fundamental limits of detecting the presence of an additive...

Please sign up or login with your details

Forgot password? Click here to reset