CUNet: A Compact Unsupervised Network for Image Classification

07/06/2016
by   Le Dong, et al.
0

In this paper, we propose a compact network called CUNet (compact unsupervised network) to counter the image classification challenge. Different from the traditional convolutional neural networks learning filters by the time-consuming stochastic gradient descent, CUNet learns the filter bank from diverse image patches with the simple K-means, which significantly avoids the requirement of scarce labeled training images, reduces the training consumption, and maintains the high discriminative ability. Besides, we propose a new pooling method named weighted pooling considering the different weight values of adjacent neurons, which helps to improve the robustness to small image distortions. In the output layer, CUNet integrates the feature maps gained in the last hidden layer, and straightforwardly computes histograms in non-overlapped blocks. To reduce feature redundancy, we implement the max-pooling operation on adjacent blocks to select the most competitive features. Comprehensive experiments are conducted to demonstrate the state-of-the-art classification performances with CUNet on CIFAR-10, STL-10, MNIST and Caltech101 benchmark datasets.

READ FULL TEXT

page 4

page 6

page 9

research
04/08/2018

Ordinal Pooling Networks: For Preserving Information over Shrinking Feature Maps

In the framework of convolutional neural networks that lie at the heart ...
research
06/10/2014

Deep Epitomic Convolutional Neural Networks

Deep convolutional neural networks have recently proven extremely compet...
research
06/02/2016

Recursive Autoconvolution for Unsupervised Learning of Convolutional Neural Networks

In visual recognition tasks, such as image classification, unsupervised ...
research
09/30/2017

PCANet-II: When PCANet Meets the Second Order Pooling

PCANet, as one noticeable shallow network, employs the histogram represe...
research
02/03/2015

Deep Boosting: Layered Feature Mining for General Image Classification

Constructing effective representations is a critical but challenging pro...
research
12/16/2013

Network In Network

We propose a novel deep network structure called "Network In Network" (N...
research
01/27/2020

Depthwise-STFT based separable Convolutional Neural Networks

In this paper, we propose a new convolutional layer called Depthwise-STF...

Please sign up or login with your details

Forgot password? Click here to reset