Learning Simple Thresholded Features with Sparse Support Recovery

04/16/2018
by   Zhangyang Wang, et al.
0

The thresholded feature has recently emerged as an extremely efficient, yet rough empirical approximation, of the time-consuming sparse coding inference process. Such an approximation has not yet been rigorously examined, and standard dictionaries often lead to non-optimal performance when used for computing thresholded features. In this paper, we first present two theoretical recovery guarantees for the thresholded feature to exactly recover the nonzero support of the sparse code. Motivated by them, we then formulate the Dictionary Learning for Thresholded Features (DLTF) model, which learns an optimized dictionary for applying the thresholded feature. In particular, for the (k, 2) norm involved, a novel proximal operator with log-linear time complexity O(m m) is derived. We evaluate the performance of DLTF on a vast range of synthetic and real-data tasks, where DLTF demonstrates remarkable efficiency, effectiveness and robustness in all experiments. In addition, we briefly discuss the potential link between DLTF and deep learning building blocks.

READ FULL TEXT

page 7

page 12

research
06/29/2021

Convolutional Sparse Coding Fast Approximation with Application to Seismic Reflectivity Estimation

In sparse coding, we attempt to extract features of input vectors, assum...
research
04/16/2016

Efficient Dictionary Learning with Sparseness-Enforcing Projections

Learning dictionaries suitable for sparse coding instead of using engine...
research
09/11/2010

Proximal Methods for Hierarchical Sparse Coding

Sparse coding consists in representing signals as sparse linear combinat...
research
04/21/2021

Efficient Sparse Coding using Hierarchical Riemannian Pursuit

Sparse coding is a class of unsupervised methods for learning a sparse r...
research
12/16/2014

Efficient GPU Implementation for Single Block Orthogonal Dictionary Learning

Dictionary training for sparse representations involves dealing with lar...
research
12/09/2018

Learning Multiplication-free Linear Transformations

In this paper, we propose several dictionary learning algorithms for spa...

Please sign up or login with your details

Forgot password? Click here to reset