Boosting Dictionary Learning with Error Codes

01/15/2017
by   Yigit Oktar, et al.
0

In conventional sparse representations based dictionary learning algorithms, initial dictionaries are generally assumed to be proper representatives of the system at hand. However, this may not be the case, especially in some systems restricted to random initializations. Therefore, a supposedly optimal state-update based on such an improper model might lead to undesired effects that will be conveyed to successive iterations. In this paper, we propose a dictionary learning method which includes a general feedback process that codes the intermediate error left over from a less intensive initial learning attempt, and then adjusts sparse codes accordingly. Experimental observations show that such an additional step vastly improves rates of convergence in high-dimensional cases, also results in better converged states in the case of random initializations. Improvements also scale up with more lenient sparsity constraints.

READ FULL TEXT
research
09/19/2014

Active Dictionary Learning in Sparse Representation Based Classification

Sparse representation, which uses dictionary atoms to reconstruct input ...
research
03/14/2021

Exact Sparse Orthogonal Dictionary Learning

Over the past decade, learning a dictionary from input images for sparse...
research
06/22/2016

When is sparse dictionary learning well-posed?

Dictionary learning methods for sparse coding have exposed underlying st...
research
12/11/2018

Semi-supervised dual graph regularized dictionary learning

In this paper, we propose a semi-supervised dictionary learning method t...
research
05/28/2012

Learning Dictionaries with Bounded Self-Coherence

Sparse coding in learned dictionaries has been established as a successf...
research
05/14/2020

Evolutionary Simplicial Learning as a Generative and Compact Sparse Framework for Classification

Dictionary learning for sparse representations has been successful in ma...
research
05/11/2014

Anomaly-Sensitive Dictionary Learning for Unsupervised Diagnostics of Solid Media

This paper proposes a strategy for the detection and triangulation of st...

Please sign up or login with your details

Forgot password? Click here to reset