Equivalence of Approximate Message Passing and Low-Degree Polynomials in Rank-One Matrix Estimation

12/14/2022
by   Andrea Montanari, et al.
0

We consider the problem of estimating an unknown parameter vector θ∈ℝ^n, given noisy observations Y = θθ^⊤/√(n)+ Z of the rank-one matrix θθ^⊤, where Z has independent Gaussian entries. When information is available about the distribution of the entries of theta, spectral methods are known to be strictly sub-optimal. Past work characterized the asymptotics of the accuracy achieved by the optimal estimator. However, no polynomial-time estimator is known that achieves this accuracy. It has been conjectured that this statistical-computation gap is fundamental, and moreover that the optimal accuracy achievable by polynomial-time estimators coincides with the accuracy achieved by certain approximate message passing (AMP) algorithms. We provide evidence towards this conjecture by proving that no estimator in the (broader) class of constant-degree polynomials can surpass AMP.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/06/2017

Estimation of Low-Rank Matrices via Approximate Message Passing

Consider the problem of estimating a low-rank symmetric matrix when its ...
research
10/07/2020

Approximate Message Passing with Spectral Initialization for Generalized Linear Models

We consider the problem of estimating a signal from measurements obtaine...
research
04/05/2019

On the computational tractability of statistical estimation on amenable graphs

We consider the problem of estimating a vector of discrete variables (θ_...
research
01/13/2022

Statistically Optimal First Order Algorithms: A Proof via Orthogonalization

We consider a class of statistical estimation problems in which we are g...
research
02/05/2016

A Note on Alternating Minimization Algorithm for the Matrix Completion Problem

We consider the problem of reconstructing a low rank matrix from a subse...
research
05/20/2022

The price of ignorance: how much does it cost to forget noise structure in low-rank matrix estimation?

We consider the problem of estimating a rank-1 signal corrupted by struc...
research
08/28/2023

Spectral Estimators for Structured Generalized Linear Models via Approximate Message Passing

We consider the problem of parameter estimation from observations given ...

Please sign up or login with your details

Forgot password? Click here to reset