Sparse LMS via Online Linearized Bregman Iteration

10/01/2012
by   Tao Hu, et al.
0

We propose a version of least-mean-square (LMS) algorithm for sparse system identification. Our algorithm called online linearized Bregman iteration (OLBI) is derived from minimizing the cumulative prediction error squared along with an l1-l2 norm regularizer. By systematically treating the non-differentiable regularizer we arrive at a simple two-step iteration. We demonstrate that OLBI is bias free and compare its operation with existing sparse LMS algorithms by rederiving them in the online convex optimization framework. We perform convergence analysis of OLBI for white input signals and derive theoretical expressions for both the steady state and instantaneous mean square deviations (MSD). We demonstrate numerically that OLBI improves the performance of LMS type algorithms for signals generated from sparse tap weights.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/22/2010

Regularized Least-Mean-Square Algorithms

We consider adaptive system identification problems with convex constrai...
research
10/09/2021

A Novel Quantum Calculus-based Complex Least Mean Square Algorithm (q-CLMS)

In this research, a novel adaptive filtering algorithm is proposed for c...
research
12/18/2019

Variants of Partial Update Augmented CLMS Algorithm and Their Performance Analysis

Naturally complex-valued information or those presented in complex domai...
research
08/25/2016

Transient performance analysis of zero-attracting LMS

Zero-attracting least-mean-square (ZA-LMS) algorithm has been widely use...
research
09/13/2021

On the Correlation between the Noise and a Priori Error Vectors in Affine Projection Algorithms

This paper analyzes the correlation matrix between the a priori error an...
research
10/30/2018

Exact Expectation Analysis of the Deficient-Length LMS Algorithm

Stochastic models that predict adaptive filtering algorithms performance...
research
02/27/2017

Multi-Label Segmentation via Residual-Driven Adaptive Regularization

We present a variational multi-label segmentation algorithm based on a r...

Please sign up or login with your details

Forgot password? Click here to reset