Sparse Estimation using Bayesian Hierarchical Prior Modeling for Real and Complex Linear Models

08/22/2011
by   Niels Lovmand Pedersen, et al.
0

In sparse Bayesian learning (SBL), Gaussian scale mixtures (GSMs) have been used to model sparsity-inducing priors that realize a class of concave penalty functions for the regression task in real-valued signal models. Motivated by the relative scarcity of formal tools for SBL in complex-valued models, this paper proposes a GSM model - the Bessel K model - that induces concave penalty functions for the estimation of complex sparse signals. The properties of the Bessel K model are analyzed when it is applied to Type I and Type II estimation. This analysis reveals that, by tuning the parameters of the mixing pdf different penalty functions are invoked depending on the estimation type used, the value of the noise variance, and whether real or complex signals are estimated. Using the Bessel K model, we derive a sparse estimator based on a modification of the expectation-maximization algorithm formulated for Type II estimation. The estimator includes as a special instance the algorithms proposed by Tipping and Faul [1] and by Babacan et al. [2]. Numerical results show the superiority of the proposed estimator over these state-of-the-art estimators in terms of convergence speed, sparseness, reconstruction error, and robustness in low and medium signal-to-noise ratio regimes.

READ FULL TEXT
research
07/22/2013

Kinetic Energy Plus Penalty Functions for Sparse Estimation

In this paper we propose and study a family of sparsity-inducing penalty...
research
12/17/2013

The Bernstein Function: A Unifying Framework of Nonconvex Penalization in Sparse Estimation

In this paper we study nonconvex penalization using Bernstein functions....
research
07/10/2012

Dual-Space Analysis of the Sparse Linear Model

Sparse linear (or generalized linear) models combine a standard likeliho...
research
12/28/2017

Sorted Concave Penalized Regression

The Lasso is biased. Concave penalized least squares estimation (PLSE) t...
research
03/25/2020

Bayesian Sparsification Methods for Deep Complex-valued Networks

With continual miniaturization ever more applications of deep learning c...
research
04/03/2012

Application of Bayesian Hierarchical Prior Modeling to Sparse Channel Estimation

Existing methods for sparse channel estimation typically provide an esti...
research
10/27/2022

Simultaneous off-the-grid learning of mixtures issued from a continuous dictionary

In this paper we observe a set, possibly a continuum, of signals corrupt...

Please sign up or login with your details

Forgot password? Click here to reset