Multi-Layer Bilinear Generalized Approximate Message Passing

07/01/2020
by   Qiuyun Zou, et al.
0

In this paper, we extend the bilinear generalized approximate message passing (BiG-AMP) approach, originally proposed for high-dimensional generalized bilinear regression, to the multi-layer case for the handling of cascaded matrix-factorization problems arising in relay communications among others. Assuming statistically independent matrix entries with known priors, we derive a new algorithm called ML-BiGAMP, which approximates the general sum-product loopy belief propagation (LBP) in the high-dimensional limit with a substantial reduction in computational complexity. We demonstrate that, in large system limits, the mean squared error (MSE) of proposed algorithm could be fully characterized via a set of simple one-dimensional equations termed state evolution (SE), which further reveals that the fixed point equations of this algorithm match perfectly with those of the exact MMSE estimator as predicted by the replica method. The exact MMSE estimator is well known to be Bayes optimal; however, due to the exponential complexity, it is infeasible to high-dimensional applications. Alternatively, the proposed (approximate) algorithm is with low complexity and could attain the same optimal MSE performance as the exact estimator in the asymptotic regime. As an illustration of the new algorithm, we then consider a particular problem of signal detection for two-hop amplify-and-forward relay communications. In that case, the proposed algorithm particularizes as a joint channel and data detection method, capable of recovering signals with high precision even in the absence of instantaneous channel state information.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/20/2020

Estimation for High-Dimensional Multi-Layer Generalized Linear Model – Part II: The ML-GAMP Estimator

This is Part II of a two-part work on the estimation for a multi-layer g...
research
09/25/2021

Replica Analysis for Generalized Linear Regression with IID Row Prior

Different from a typical independent identically distributed (IID) eleme...
research
07/20/2020

Estimation for High-Dimensional Multi-Layer Generalized Linear Model – Part I: The Exact MMSE Estimator

This two-part work considers the minimum means square error (MMSE) estim...
research
08/21/2023

Integrated Sensing and Communications for 3D Object Imaging via Bilinear Inference

We consider an uplink integrated sensing and communications (ISAC) scena...
research
09/15/2020

Bilinear Generalized Vector Approximate Message Passing

We introduce the bilinear generalized vector approximate message passing...
research
05/13/2019

Generalized Approximate Survey Propagation for High-Dimensional Estimation

In Generalized Linear Estimation (GLE) problems, we seek to estimate a s...
research
09/25/2022

Equivalence of state equations from different methods in High-dimensional Regression

State equations (SEs) were firstly introduced in the approximate message...

Please sign up or login with your details

Forgot password? Click here to reset