Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks

by   Alexey Dosovitskiy, et al.
University of Freiburg

Deep convolutional networks have proven to be very successful in learning task specific features that allow for unprecedented performance on various computer vision tasks. Training of such networks follows mostly the supervised learning paradigm, where sufficiently many input-output pairs are required for training. Acquisition of large training sets is one of the key challenges, when approaching a new task. In this paper, we aim for generic feature learning and present an approach for training a convolutional network using only unlabeled data. To this end, we train the network to discriminate between a set of surrogate classes. Each surrogate class is formed by applying a variety of transformations to a randomly sampled 'seed' image patch. In contrast to supervised network training, the resulting feature representation is not class specific. It rather provides robustness to the transformations that have been applied during training. This generic feature representation allows for classification results that outperform the state of the art for unsupervised learning on several popular datasets (STL-10, CIFAR-10, Caltech-101, Caltech-256). While such generic features cannot compete with class specific features from supervised training on a classification task, we show that they are advantageous on geometric matching problems, where they also outperform the SIFT descriptor.


page 2

page 6

page 7

page 11


Unsupervised feature learning by augmenting single images

When deep learning is applied to visual object recognition, data augment...

Local Unsupervised Learning for Image Analysis

Local Hebbian learning is believed to be inferior in performance to end-...

Improving Spatiotemporal Self-Supervision by Deep Reinforcement Learning

Self-supervised learning of convolutional neural networks can harness la...

Unsupervised Representation Learning by Predicting Image Rotations

Over the last years, deep convolutional neural networks (ConvNets) have ...

DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition

We evaluate whether features extracted from the activation of a deep con...

Unsupervised Feature Learning with C-SVDDNet

In this paper, we investigate the problem of learning feature representa...

Surprising Effectiveness of Few-Image Unsupervised Feature Learning

State-of-the-art methods for unsupervised representation learning can tr...

Please sign up or login with your details

Forgot password? Click here to reset