IRLS and Slime Mold: Equivalence and Convergence

01/12/2016
by   Damian Straszak, et al.
0

In this paper we present a connection between two dynamical systems arising in entirely different contexts: one in signal processing and the other in biology. The first is the famous Iteratively Reweighted Least Squares (IRLS) algorithm used in compressed sensing and sparse recovery while the second is the dynamics of a slime mold (Physarum polycephalum). Both of these dynamics are geared towards finding a minimum l1-norm solution in an affine subspace. Despite its simplicity the convergence of the IRLS method has been shown only for a certain regularization of it and remains an important open problem. Our first result shows that the two dynamics are projections of the same dynamical system in higher dimensions. As a consequence, and building on the recent work on Physarum dynamics, we are able to prove convergence and obtain complexity bounds for a damped version of the IRLS algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/07/2018

A biconvex analysis for Lasso l1 reweighting

l1 reweighting algorithms are very popular in sparse signal recovery and...
research
09/21/2020

A mathematical approach to resilience

In this paper, we evolve from sparsity, a key concept in robust statisti...
research
12/22/2021

On Asymptotic Linear Convergence of Projected Gradient Descent for Constrained Least Squares

Many recent problems in signal processing and machine learning such as c...
research
11/12/2019

Inducing strong convergence of trajectories in dynamical systems associated to monotone inclusions with composite structure

In this work we investigate dynamical systems designed to approach the s...
research
10/15/2019

IRLS for Sparse Recovery Revisited: Examples of Failure and a Remedy

Compressed sensing is a central topic in signal processing with myriad a...
research
11/17/2011

Analog Sparse Approximation with Applications to Compressed Sensing

Recent research has shown that performance in signal processing tasks ca...

Please sign up or login with your details

Forgot password? Click here to reset