A Max-Product EM Algorithm for Reconstructing Markov-tree Sparse Signals from Compressive Samples

09/05/2012
by   Zhao Song, et al.
0

We propose a Bayesian expectation-maximization (EM) algorithm for reconstructing Markov-tree sparse signals via belief propagation. The measurements follow an underdetermined linear model where the regression-coefficient vector is the sum of an unknown approximately sparse signal and a zero-mean white Gaussian noise with an unknown variance. The signal is composed of large- and small-magnitude components identified by binary state variables whose probabilistic dependence structure is described by a Markov tree. Gaussian priors are assigned to the signal coefficients given their state variables and the Jeffreys' noninformative prior is assigned to the noise variance. Our signal reconstruction scheme is based on an EM iteration that aims at maximizing the posterior distribution of the signal and its state variables given the noise variance. We construct the missing data for the EM iteration so that the complete-data posterior distribution corresponds to a hidden Markov tree (HMT) probabilistic graphical model that contains no loops and implement its maximization (M) step via a max-product algorithm. This EM algorithm estimates the vector of state variables as well as solves iteratively a linear system of equations to obtain the corresponding signal estimate. We select the noise variance so that the corresponding estimated signal and state variables obtained upon convergence of the EM iteration have the largest marginal posterior distribution. We compare the proposed and existing state-of-the-art reconstruction methods via signal and image reconstruction experiments.

READ FULL TEXT

page 5

page 22

page 24

research
12/07/2014

Iterative Bayesian Reconstruction of Non-IID Block-Sparse Signals

This paper presents a novel Block Iterative Bayesian Algorithm (Block-IB...
research
03/31/2021

The Expectation-Maximization Algorithm for Continuous-time Hidden Markov Models

We propose a unified framework that extends the inference methods for cl...
research
12/11/2020

Clustered Sparse Channel Estimation for Massive MIMO Systems by Expectation Maximization-Propagation (EM-EP)

We study the problem of downlink channel estimation in multi-user massiv...
research
08/16/2018

Adaptive Detection of Structured Signals in Low-Rank Interference

In this paper, we consider the problem of detecting the presence (or abs...
research
11/18/2014

The NLMS algorithm with time-variant optimum stepsize derived from a Bayesian network perspective

In this article, we derive a new stepsize adaptation for the normalized ...
research
03/28/2022

Instantaneous Frequency Estimation In Multi-Component Signals Using Stochastic EM Algorithm

This paper addresses the problem of estimating the modes of an observed ...
research
01/11/2014

Multiscale Shrinkage and Lévy Processes

A new shrinkage-based construction is developed for a compressible vecto...

Please sign up or login with your details

Forgot password? Click here to reset