Using ROC and Unlabeled Data for Increasing Low-Shot Transfer Learning Classification Accuracy

by   Spiridon Kasapis, et al.

One of the most important characteristics of human visual intelligence is the ability to identify unknown objects. The capability to distinguish between a substance which a human mind has no previous experience of and a familiar object, is innate to every human. In everyday life, within seconds of seeing an "unknown" object, we are able to categorize it as such without any substantial effort. Convolutional Neural Networks, regardless of how they are trained (i.e. in a conventional manner or through transfer learning) can recognize only the classes that they are trained for. When using them for classification, any candidate image will be placed in one of the available classes. We propose a low-shot classifier which can serve as the top layer to any existing CNN that the feature extractor was already trained. Using a limited amount of labeled data for the type of images which need to be specifically classified along with unlabeled data for all other images, a unique target matrix and a Receiver Operator Curve (ROC) criterion, we are able to increase identification accuracy by up to 30 retaining the ability to identify images that belong to the specific classes of interest.



There are no comments yet.


page 3

page 5


Data-Efficient Classification of Birdcall Through Convolutional Neural Networks Transfer Learning

Deep learning Convolutional Neural Network (CNN) models are powerful cla...

STAR: Noisy Semi-Supervised Transfer Learning for Visual Classification

Semi-supervised learning (SSL) has proven to be effective at leveraging ...

Unlabeled Data Deployment for Classification of Diabetic Retinopathy Images Using Knowledge Transfer

Convolutional neural networks (CNNs) are extensively beneficial for medi...

Composer Style Classification of Piano Sheet Music Images Using Language Model Pretraining

This paper studies composer style classification of piano sheet music im...

Deep Metric Transfer for Label Propagation with Limited Annotated Data

We study object recognition under the constraint that each object class ...

Unsupervised vs. transfer learning for multimodal one-shot matching of speech and images

We consider the task of multimodal one-shot speech-image matching. An ag...

Learning to see across Domains and Modalities

Deep learning has raised hopes and expectations as a general solution fo...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.