Ordinary Differential Equation-based Sparse Signal Recovery

03/29/2023
by   Tadashi Wadayama, et al.
0

This study investigates the use of continuous-time dynamical systems for sparse signal recovery. The proposed dynamical system is in the form of a nonlinear ordinary differential equation (ODE) derived from the gradient flow of the Lasso objective function. The sparse signal recovery process of this ODE-based approach is demonstrated by numerical simulations using the Euler method. The state of the continuous-time dynamical system eventually converges to the equilibrium point corresponding to the minimum of the objective function. To gain insight into the local convergence properties of the system, a linear approximation around the equilibrium point is applied, yielding a closed-form error evolution ODE. This analysis shows the behavior of convergence to the equilibrium point. In addition, a variational optimization problem is proposed to optimize a time-dependent regularization parameter in order to improve both convergence speed and solution quality. The deep unfolded-variational optimization method is introduced as a means of solving this optimization problem, and its effectiveness is validated through numerical experiments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/04/2018

Convergence of the ADAM algorithm from a Dynamical System Viewpoint

Adam is a popular variant of the stochastic gradient descent for finding...
research
05/03/2022

MMSE Signal Detection for MIMO Systems based on Ordinary Differential Equation

Motivated by emerging technologies for energy efficient analog computing...
research
03/30/2023

Stochastic Dynamics of Noisy Average Consensus: Analysis and Optimization

A continuous-time average consensus system is a linear dynamical system ...
research
05/17/2019

A Dynamical Systems Perspective on Nesterov Acceleration

We present a dynamical system framework for understanding Nesterov's acc...
research
11/12/2019

Shadowing Properties of Optimization Algorithms

Ordinary differential equation (ODE) models of gradient-based optimizati...
research
08/12/2021

Prediction of dynamical systems using geometric constraints imposed by observations

Solution of Ordinary Differential Equation (ODE) model of dynamical syst...
research
03/11/2015

A Neurodynamical System for finding a Minimal VC Dimension Classifier

The recently proposed Minimal Complexity Machine (MCM) finds a hyperplan...

Please sign up or login with your details

Forgot password? Click here to reset