The Interpretable Dictionary in Sparse Coding

11/24/2020
by   Edward Kim, et al.
55

Artificial neural networks (ANNs), specifically deep learning networks, have often been labeled as black boxes due to the fact that the internal representation of the data is not easily interpretable. In our work, we illustrate that an ANN, trained using sparse coding under specific sparsity constraints, yields a more interpretable model than the standard deep learning model. The dictionary learned by sparse coding can be more easily understood and the activations of these elements creates a selective feature output. We compare and contrast our sparse coding model with an equivalent feed forward convolutional autoencoder trained on the same data. Our results show both qualitative and quantitative benefits in the interpretation of the learned sparse coding dictionary as well as the internal activation representations.

READ FULL TEXT

page 3

page 4

page 5

page 6

research
02/24/2023

Hiding Data Helps: On the Benefits of Masking for Sparse Coding

Sparse coding refers to modeling a signal as sparse linear combinations ...
research
08/02/2015

Toward a Robust Sparse Data Representation for Wireless Sensor Networks

Compressive sensing has been successfully used for optimized operations ...
research
09/01/2015

Learning A Task-Specific Deep Architecture For Clustering

While sparse coding-based clustering methods have shown to be successful...
research
02/22/2023

Sparse, Geometric Autoencoder Models of V1

The classical sparse coding model represents visual stimuli as a linear ...
research
09/08/2014

When coding meets ranking: A joint framework based on local learning

Sparse coding, which represents a data point as a sparse reconstruction ...
research
04/17/2016

Structured Sparse Convolutional Autoencoder

This paper aims to improve the feature learning in Convolutional Network...
research
10/08/2018

Ineffectiveness of Dictionary Coding to Infer Predictability Limits of Human Mobility

Recently, a series of models have been proposed to predict future moveme...

Please sign up or login with your details

Forgot password? Click here to reset