DeepAI AI Chat
Log In Sign Up

Learned ISTA with Error-based Thresholding for Adaptive Sparse Coding

12/21/2021
by   Ziang Li, et al.
Tsinghua University
0

The learned iterative shrinkage thresholding algorithm (LISTA) introduces deep unfolding models with learnable thresholds in some shrinkage functions for sparse coding. Drawing on some theoretical insights, we advocate an error-based thresholding (EBT) mechanism for LISTA, which leverages a function of the layer-wise reconstruction error to suggest an appropriate threshold value for each observation on each layer. We show that the EBT mechanism well disentangles the learnable parameters in the shrinkage functions from the reconstruction errors, making them more adaptive to the various observations. With rigorous theoretical analyses, we show that the proposed EBT can lead to a faster convergence on the basis of LISTA and its variants, in addition to its higher adaptivity. Extensive experimental results confirm our theoretical analyses and verify the effectiveness of our methods.

READ FULL TEXT
06/22/2021

Learned Interpretable Residual Extragradient ISTA for Sparse Coding

Recently, the study on learned iterative shrinkage thresholding algorith...
02/06/2023

RDFNet: Regional Dynamic FISTA-Net for Spectral Snapshot Compressive Imaging

Deep convolutional neural networks have recently shown promising results...
01/30/2021

Metalearning: Sparse Variable-Structure Automata

Dimension of the encoder output (i.e., the code layer) in an autoencoder...
10/29/2021

Hyperparameter Tuning is All You Need for LISTA

Learned Iterative Shrinkage-Thresholding Algorithm (LISTA) introduces th...
10/14/2020

Learned Greedy Method (LGM): A Novel Neural Architecture for Sparse Coding and Beyond

The fields of signal and image processing have been deeply influenced by...
10/05/2020

Neurally Augmented ALISTA

It is well-established that many iterative sparse reconstruction algorit...