Optimal Algorithms for the Inhomogeneous Spiked Wigner Model

02/13/2023
by   Aleksandr Pak, et al.
0

In this paper, we study a spiked Wigner problem with an inhomogeneous noise profile. Our aim in this problem is to recover the signal passed through an inhomogeneous low-rank matrix channel. While the information-theoretic performances are well-known, we focus on the algorithmic problem. We derive an approximate message-passing algorithm (AMP) for the inhomogeneous problem and show that its rigorous state evolution coincides with the information-theoretic optimal Bayes fixed-point equations. We identify in particular the existence of a statistical-to-computational gap where known algorithms require a signal-to-noise ratio bigger than the information-theoretic threshold to perform better than random. Finally, from the adapted AMP iteration we deduce a simple and efficient spectral method that can be used to recover the transition for matrices with general variance profiles. This spectral method matches the conjectured optimal computational phase transition.

READ FULL TEXT

page 5

page 16

research
05/15/2018

On the glassy nature of the hard phase in inference problems

An algorithmically hard phase was described in a range of inference prob...
research
06/12/2018

Phase transitions in spiked matrix estimation: information-theoretic analysis

We study here the so-called spiked Wigner and Wishart models, where one ...
research
05/26/2022

Subspace clustering in high-dimensions: Phase transitions & Statistical-to-Computational gap

A simple model to study subspace clustering is the high-dimensional k-Ga...
research
10/03/2022

Bayes-optimal limits in structured PCA, and how to reach them

We study the paradigmatic spiked matrix model of principal components an...
research
03/22/2022

Spectral Algorithms Optimally Recover (Censored) Planted Dense Subgraphs

We study spectral algorithms for the planted dense subgraph problem (PDS...
research
06/09/2020

Phase retrieval in high dimensions: Statistical and computational phase transitions

We consider the phase retrieval problem of reconstructing a n-dimensiona...
research
05/29/2019

The spiked matrix model with generative priors

Using a low-dimensional parametrization of signals is a generic and powe...

Please sign up or login with your details

Forgot password? Click here to reset