Regularized Least-Mean-Square Algorithms

12/22/2010
by   Yilun Chen, et al.
0

We consider adaptive system identification problems with convex constraints and propose a family of regularized Least-Mean-Square (LMS) algorithms. We show that with a properly selected regularization parameter the regularized LMS provably dominates its conventional counterpart in terms of mean square deviations. We establish simple and closed-form expressions for choosing this regularization parameter. For identifying an unknown sparse system we propose sparse and group-sparse LMS algorithms, which are special examples of the regularized LMS family. Simulation results demonstrate the advantages of the proposed filters in both convergence rate and steady-state error under sparsity assumptions on the true coefficient vector.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/08/2021

Mean-square Analysis of the NLMS Algorithm

This work presents a novel approach to the mean-square analysis of the n...
research
10/01/2012

Sparse LMS via Online Linearized Bregman Iteration

We propose a version of least-mean-square (LMS) algorithm for sparse sys...
research
12/18/2019

Variants of Partial Update Augmented CLMS Algorithm and Their Performance Analysis

Naturally complex-valued information or those presented in complex domai...
research
07/16/2015

Recursive Sparse Point Process Regression with Application to Spectrotemporal Receptive Field Plasticity Analysis

We consider the problem of estimating the sparse time-varying parameter ...
research
08/25/2016

Transient performance analysis of zero-attracting LMS

Zero-attracting least-mean-square (ZA-LMS) algorithm has been widely use...
research
09/13/2021

On the Correlation between the Noise and a Priori Error Vectors in Affine Projection Algorithms

This paper analyzes the correlation matrix between the a priori error an...
research
03/17/2017

Algorithm/Architecture Co-design of Proportionate-type LMS Adaptive Filters for Sparse System Identification

This paper investigates the problem of implementing proportionate-type L...

Please sign up or login with your details

Forgot password? Click here to reset