Multi-Layer Bilinear Generalized Approximate Message Passing

07/01/2020
by   Qiuyun Zou, et al.
0

In this paper, we extend the bilinear generalized approximate message passing (BiG-AMP) approach, originally proposed for high-dimensional generalized bilinear regression, to the multi-layer case for the handling of cascaded matrix-factorization problems arising in relay communications among others. Assuming statistically independent matrix entries with known priors, we derive a new algorithm called ML-BiGAMP, which approximates the general sum-product loopy belief propagation (LBP) in the high-dimensional limit with a substantial reduction in computational complexity. We demonstrate that, in large system limits, the mean squared error (MSE) of proposed algorithm could be fully characterized via a set of simple one-dimensional equations termed state evolution (SE), which further reveals that the fixed point equations of this algorithm match perfectly with those of the exact MMSE estimator as predicted by the replica method. The exact MMSE estimator is well known to be Bayes optimal; however, due to the exponential complexity, it is infeasible to high-dimensional applications. Alternatively, the proposed (approximate) algorithm is with low complexity and could attain the same optimal MSE performance as the exact estimator in the asymptotic regime. As an illustration of the new algorithm, we then consider a particular problem of signal detection for two-hop amplify-and-forward relay communications. In that case, the proposed algorithm particularizes as a joint channel and data detection method, capable of recovering signals with high precision even in the absence of instantaneous channel state information.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

07/20/2020

Estimation for High-Dimensional Multi-Layer Generalized Linear Model – Part II: The ML-GAMP Estimator

This is Part II of a two-part work on the estimation for a multi-layer g...
09/25/2021

Replica Analysis for Generalized Linear Regression with IID Row Prior

Different from a typical independent identically distributed (IID) eleme...
07/20/2020

Estimation for High-Dimensional Multi-Layer Generalized Linear Model – Part I: The Exact MMSE Estimator

This two-part work considers the minimum means square error (MMSE) estim...
05/13/2019

Generalized Approximate Survey Propagation for High-Dimensional Estimation

In Generalized Linear Estimation (GLE) problems, we seek to estimate a s...
09/15/2020

Bilinear Generalized Vector Approximate Message Passing

We introduce the bilinear generalized vector approximate message passing...
12/14/2021

The high-dimensional asymptotics of first order methods with random data

We study a class of deterministic flows in ℝ^d× k, parametrized by a ran...
07/03/2018

Approximate Survey Propagation for Statistical Inference

Approximate message passing algorithm enjoyed considerable attention in ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.