Generalized Memory Approximate Message Passing

10/12/2021
by   Feiyan Tian, et al.
0

Generalized approximate message passing (GAMP) is a promising technique for unknown signal reconstruction of generalized linear models (GLM). However, it requires that the transformation matrix has independent and identically distributed (IID) entries. In this context, generalized vector AMP (GVAMP) is proposed for general unitarily-invariant transformation matrices but it has a high-complexity matrix inverse. To this end, we propose a universal generalized memory AMP (GMAMP) framework including the existing orthogonal AMP/VAMP, GVAMP, and memory AMP (MAMP) as special instances. Due to the characteristics that local processors are all memory, GMAMP requires stricter orthogonality to guarantee the asymptotic IID Gaussianity and state evolution. To satisfy such orthogonality, local orthogonal memory estimators are established. The GMAMP framework provides a principle toward building new advanced AMP-type algorithms. As an example, we construct a Bayes-optimal GMAMP (BO-GMAMP), which uses a low-complexity memory linear estimator to suppress the linear interference, and thus its complexity is comparable to GAMP. Furthermore, we prove that for unitarily-invariant transformation matrices, BO-GMAMP achieves the replica minimum (i.e., Bayes-optimal) MSE if it has a unique fixed point.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/20/2020

Memory Approximate Message Passing

Approximate message passing (AMP) is a low-cost iterative parameter-esti...
research
12/08/2021

Estimation in Rotationally Invariant Generalized Linear Models via Approximate Message Passing

We consider the problem of signal estimation in generalized linear model...
research
03/27/2020

Bayes-Optimal Convolutional AMP

This paper proposes Bayes-optimal convolutional approximate message-pass...
research
12/31/2021

Sufficient Statistic Memory AMP

Approximate message passing (AMP) is a promising technique for unknown s...
research
06/11/2020

Asymptotic Errors for Teacher-Student Convex Generalized Linear Models (or : How to Prove Kabashima's Replica Formula)

There has been a recent surge of interest in the study of asymptotic rec...
research
06/11/2019

On the Universality of Noiseless Linear Estimation with Respect to the Measurement Matrix

In a noiseless linear estimation problem, one aims to reconstruct a vect...
research
10/12/2022

Orthogonal Approximate Message-Passing for Spatially Coupled Systems

Orthogonal approximate message-passing (OAMP) is proposed for signal rec...

Please sign up or login with your details

Forgot password? Click here to reset