On the Universality of Noiseless Linear Estimation with Respect to the Measurement Matrix

06/11/2019
by   Alia Abbara, et al.
1

In a noiseless linear estimation problem, one aims to reconstruct a vector x* from the knowledge of its linear projections y=Phi x*. There have been many theoretical works concentrating on the case where the matrix Phi is a random i.i.d. one, but a number of heuristic evidence suggests that many of these results are universal and extend well beyond this restricted case. Here we revisit this problematic through the prism of development of message passing methods, and consider not only the universality of the l1 transition, as previously addressed, but also the one of the optimal Bayesian reconstruction. We observed that the universality extends to the Bayes-optimal minimum mean-squared (MMSE) error, and to a range of structured matrices.

READ FULL TEXT
research
06/21/2022

Warm-Starting in Message Passing algorithms

Vector Approximate Message Passing (VAMP) provides the means of solving ...
research
01/19/2022

A Concise Tutorial on Approximate Message Passing

High-dimensional signal recovery of standard linear regression is a key ...
research
10/12/2021

Generalized Memory Approximate Message Passing

Generalized approximate message passing (GAMP) is a promising technique ...
research
01/02/2018

Performance Limits with Additive Error Metrics in Noisy Multi-Measurement Vector Problem

Real-world applications such as magnetic resonance imaging with multiple...
research
07/04/2019

Bayesian Nonlinear Function Estimation with Approximate Message Passing

In many areas, massive amounts of data are collected and analyzed in ord...
research
06/27/2018

Plug-in Estimation in High-Dimensional Linear Inverse Problems: A Rigorous Analysis

Estimating a vector x from noisy linear measurements Ax+w often requires...
research
12/20/2022

Random linear estimation with rotationally-invariant designs: Asymptotics at high temperature

We study estimation in the linear model y=Aβ^⋆+ϵ, in a Bayesian setting ...

Please sign up or login with your details

Forgot password? Click here to reset