Incremental maximum likelihood estimation for efficient adaptive filtering

09/04/2022
by   Shirin Jalali, et al.
0

Adaptive filtering is a well-known problem with a wide range of applications, including echo cancellation. Extensive research during the past few decades has led to the invention of various algorithms. However, the known computationally-efficient solutions show a tradeoff between convergence speed and accuracy. Moreover, running these algorithms involves heuristically setting various parameters that considerably affect their performances. In this paper, we propose a new algorithm which we refer to as online block maximum likelihood (OBML). OBML is a computationally-efficient online learning algorithm that employs maximum likelihood (ML) estimation every P samples. We fully characterize the expected performance of OBML and show that i) OBML is able to asymptotically recover the unknown coefficients and ii) its expected estimation error asymptotically converges to zero as O(1 t). We also derive an alternative version of OBML, which we refer to as incremental maximum likelihood (IML), which incrementally updates its ML estimate of the coefficients at every sample. Our simulation results verify the analytical conclusions for memoryless inputs, and also show excellent performance of both OBML and IML in an audio echo cancellation application with strongly correlated input signals.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/28/2021

A Computationally Efficient Method for Learning Exponential Family Distributions

We consider the question of learning the natural parameters of a k param...
research
09/16/2022

Maximum likelihood estimation and prediction error for a Matérn model on the circle

This work considers Gaussian process interpolation with a periodized ver...
research
05/17/2019

Maximum Likelihood Estimation of Toric Fano Varieties

We study the maximum likelihood estimation problem for several classes o...
research
03/10/2020

A Maximum Likelihood Approach to Speed Estimation of Foreground Objects in Video Signals

Motion and speed estimation play a key role in computer vision and video...
research
02/09/2023

Stochastic Maximum Likelihood Direction Finding in the Presence of Nonuniform Noise Fields

In this letter, we employ and design the expectation–conditional maximiz...
research
06/03/2023

Provable benefits of score matching

Score matching is an alternative to maximum likelihood (ML) for estimati...
research
04/12/2019

Geometry-Aware Maximum Likelihood Estimation of Intrinsic Dimension

The existing approaches to intrinsic dimension estimation usually are no...

Please sign up or login with your details

Forgot password? Click here to reset