Sparse Coding on Stereo Video for Object Detection

05/19/2017
by   Sheng Y. Lundquist, et al.
0

Deep Convolutional Neural Networks (DCNN) require millions of labeled training examples for image classification and object detection tasks, which restrict these models to domains where such datasets are available. In this paper, we explore the use of unsupervised sparse coding applied to stereo-video data to help alleviate the need for large amounts of labeled data. We show that replacing a typical supervised convolutional layer with an unsupervised sparse-coding layer within a DCNN allows for better performance on a car detection task when only a limited number of labeled training examples is available. Furthermore, the network that incorporates sparse coding allows for more consistent performance over varying initializations and ordering of training examples when compared to a fully supervised DCNN. Finally, we compare activations between the unsupervised sparse-coding layer and the supervised convolutional layer, and show that the sparse representation exhibits an encoding that is depth selective, whereas encodings from the convolutional layer do not exhibit such selectivity. These result indicates promise for using unsupervised sparse-coding approaches in real-world computer vision tasks in domains with limited labeled training data.

READ FULL TEXT

page 5

page 6

page 7

research
06/07/2016

Selective Unsupervised Feature Learning with Convolutional Neural Network (S-CNN)

Supervised learning of convolutional neural networks (CNNs) can require ...
research
08/23/2023

LCANets++: Robust Audio Classification using Multi-layer Neural Networks with Lateral Competition

Audio classification aims at recognizing audio signals, including speech...
research
05/22/2019

Data-Efficient Image Recognition with Contrastive Predictive Coding

Large scale deep learning excels when labeled images are abundant, yet d...
research
08/14/2021

A Sparse Coding Interpretation of Neural Networks and Theoretical Implications

Neural networks, specifically deep convolutional neural networks, have a...
research
12/04/2018

From biological vision to unsupervised hierarchical sparse coding

The formation of connections between neural cells is emerging essentiall...
research
07/19/2019

Learning More From Less: Towards Strengthening Weak Supervision for Ad-Hoc Retrieval

The limited availability of ground truth relevance labels has been a maj...
research
05/14/2020

Taskology: Utilizing Task Relations at Scale

It has been recognized that the joint training of computer vision tasks ...

Please sign up or login with your details

Forgot password? Click here to reset