Unsupervised feature learning by augmenting single images

12/18/2013
by   Alexey Dosovitskiy, et al.
0

When deep learning is applied to visual object recognition, data augmentation is often used to generate additional training data without extra labeling cost. It helps to reduce overfitting and increase the performance of the algorithm. In this paper we investigate if it is possible to use data augmentation as the main component of an unsupervised feature learning architecture. To that end we sample a set of random image patches and declare each of them to be a separate single-image surrogate class. We then extend these trivial one-element classes by applying a variety of transformations to the initial 'seed' patches. Finally we train a convolutional neural network to discriminate between these surrogate classes. The feature representation learned by the network can then be used in various vision tasks. We find that this simple feature learning algorithm is surprisingly successful, achieving competitive classification results on several popular vision datasets (STL-10, CIFAR-10, Caltech-101).

READ FULL TEXT
research
06/26/2014

Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks

Deep convolutional networks have proven to be very successful in learnin...
research
12/23/2014

Unsupervised Feature Learning with C-SVDDNet

In this paper, we investigate the problem of learning feature representa...
research
04/30/2019

Surprising Effectiveness of Few-Image Unsupervised Feature Learning

State-of-the-art methods for unsupervised representation learning can tr...
research
06/07/2016

Selective Unsupervised Feature Learning with Convolutional Neural Network (S-CNN)

Supervised learning of convolutional neural networks (CNNs) can require ...
research
09/28/2016

Understanding data augmentation for classification: when to warp?

In this paper we investigate the benefit of augmenting data with synthet...
research
10/25/2022

The Curious Case of Benign Memorization

Despite the empirical advances of deep learning across a variety of lear...
research
06/16/2021

Evolving Image Compositions for Feature Representation Learning

Convolutional neural networks for visual recognition require large amoun...

Please sign up or login with your details

Forgot password? Click here to reset