Exact Expectation Analysis of the Deficient-Length LMS Algorithm

10/30/2018
by   Pedro Lara, et al.
0

Stochastic models that predict adaptive filtering algorithms performance usually employ several assumptions in order to simplify the analysis. Although these simplifications facilitate the recursive update of the statistical quantities of interest, they by themselves may hamper the modeling accuracy. This paper simultaneously avoids for the first time the employment of two ubiquitous assumptions often adopted in the analysis of the least mean squares algorithm. The first of them is the so-called independence assumption, which presumes statistical independence between adaptive coefficients and input data. The second one assumes a sufficient-order configuration, in which the lengths of the unknown plant and the adaptive filter are equal. State equations that characterize both the mean and mean square performance of the deficient-length configuration without using the independence assumption are provided. The devised analysis, encompassing both transient and steady-state regimes, is not restricted neither to white nor to Gaussian input signals and is able to provide a proper step size upper bound that guarantees stability.

READ FULL TEXT
research
09/13/2021

On the Correlation between the Noise and a Priori Error Vectors in Affine Projection Algorithms

This paper analyzes the correlation matrix between the a priori error an...
research
10/06/2016

Constrained Maximum Correntropy Adaptive Filtering

Constrained adaptive filtering algorithms inculding constrained least me...
research
10/14/2014

A stochastic behavior analysis of stochastic restricted-gradient descent algorithm in reproducing kernel Hilbert spaces

This paper presents a stochastic behavior analysis of a kernel-based sto...
research
11/07/2022

Robust Total Least Mean M-Estimate normalized subband filter Adaptive Algorithm for impulse noises and noisy inputs

When the input signal is correlated input signals, and the input and out...
research
10/01/2012

Sparse LMS via Online Linearized Bregman Iteration

We propose a version of least-mean-square (LMS) algorithm for sparse sys...
research
01/27/2015

A Probabilistic Least-Mean-Squares Filter

We introduce a probabilistic approach to the LMS filter. By means of an ...
research
06/13/2023

Exact Mean Square Linear Stability Analysis for SGD

The dynamical stability of optimization methods at the vicinity of minim...

Please sign up or login with your details

Forgot password? Click here to reset