Supervised Deep Sparse Coding Networks

01/29/2017
by   Xiaoxia Sun, et al.
0

In this paper, we describe the deep sparse coding network (SCN), a novel deep network that encodes intermediate representations with nonnegative sparse coding. The SCN is built upon a number of cascading bottleneck modules, where each module consists of two sparse coding layers with relatively wide and slim dictionaries that are specialized to produce high dimensional discriminative features and low dimensional representations for clustering, respectively. During training, both the dictionaries and regularization parameters are optimized with an end-to-end supervised learning algorithm based on multilevel optimization. Effectiveness of an SCN with seven bottleneck modules is verified on several popular benchmark datasets. Remarkably, with few parameters to learn, our SCN achieves 5.81 and CIFAR-100, respectively.

READ FULL TEXT
research
01/05/2015

Sparse Deep Stacking Network for Image Classification

Sparse coding can learn good robust representation to noise and model mo...
research
04/08/2018

Supervised Convolutional Sparse Coding

Convolutional Sparse Coding (CSC) is a well-established image representa...
research
07/26/2017

Learning Sparse Representations in Reinforcement Learning with Sparse Coding

A variety of representation learning approaches have been investigated f...
research
03/03/2013

Learning Stable Multilevel Dictionaries for Sparse Representations

Sparse representations using learned dictionaries are being increasingly...
research
05/07/2022

Variational Sparse Coding with Learned Thresholding

Sparse coding strategies have been lauded for their parsimonious represe...
research
06/15/2020

Learning Diverse and Discriminative Representations via the Principle of Maximal Coding Rate Reduction

To learn intrinsic low-dimensional structures from high-dimensional data...
research
09/01/2015

Learning A Task-Specific Deep Architecture For Clustering

While sparse coding-based clustering methods have shown to be successful...

Please sign up or login with your details

Forgot password? Click here to reset