Do Proportionate Algorithms Exploit Sparsity?

08/16/2021
by   Markus V. S. Lima, et al.
0

Adaptive filters exploiting sparsity have been a very active research field, among which the algorithms that follow the "proportional-update principle", the so-called proportionate-type algorithms, are very popular. Indeed, there are hundreds of works on proportionate-type algorithms and, therefore, their advantages are widely known. This paper addresses the unexplored drawbacks and limitations of using proportional updates and their practical impacts. Our findings include the theoretical justification for the poor performance of these algorithms in several sparse scenarios, and also when dealing with non-stationary and compressible systems. Simulation results corroborating the theory are presented.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/14/2022

Multiple Choice Hard Thresholding Pursuit (MCHTP) for Simultaneous Sparse Recovery and Sparsity Order Estimation

We address the problem of sparse recovery using greedy compressed sensin...
research
10/16/2018

Study of Sparsity-Aware Subband Adaptive Filtering Algorithms with Adjustable Penalties

We propose two sparsity-aware normalized subband adaptive filter (NSAF) ...
research
02/04/2005

Oiling the Wheels of Change: The Role of Adaptive Automatic Problem Decomposition in Non--Stationary Environments

Genetic algorithms (GAs) that solve hard problems quickly, reliably and ...
research
10/16/2020

Adaptive Dense-to-Sparse Paradigm for Pruning Online Recommendation System with Non-Stationary Data

Large scale deep learning provides a tremendous opportunity to improve t...
research
08/31/2022

Proportional algebras, homomorphisms, congruences, and functors

This paper introduces proportional algebras as algebras endowed with the...
research
07/28/2017

A Survey of Learning in Multiagent Environments: Dealing with Non-Stationarity

The key challenge in multiagent learning is learning a best response to ...
research
04/10/2019

Cyclic Coding Algorithms under MorphoSys Reconfigurable Computing System

This paper introduces reconfigurable computing (RC) and specifically cho...

Please sign up or login with your details

Forgot password? Click here to reset