Training Deep Neural Networks on Noisy Labels with Bootstrapping

by   Scott Reed, et al.

Current state-of-the-art deep learning systems for visual object recognition and detection use purely supervised training with regularization such as dropout to avoid overfitting. The performance depends critically on the amount of labeled examples, and in current practice the labels are assumed to be unambiguous and accurate. However, this assumption often does not hold; e.g. in recognition, class labels may be missing; in detection, objects in the image may not be localized; and in general, the labeling may be subjective. In this work we propose a generic way to handle noisy and incomplete labeling by augmenting the prediction objective with a notion of consistency. We consider a prediction consistent if the same prediction is made given similar percepts, where the notion of similarity is between deep network features computed from the input data. In experiments we demonstrate that our approach yields substantial robustness to label noise on several datasets. On MNIST handwritten digits, we show that our model is robust to label corruption. On the Toronto Face Database, we show that our model handles well the case of subjective labels in emotion recognition, achieving state-of-the- art results, and can also benefit from unlabeled face images with no modification to our method. On the ILSVRC2014 detection challenge data, we show that our approach extends to very deep networks, high resolution images and structured outputs, and results in improved scalable detection.


page 7

page 8


Learning Deep Networks from Noisy Labels with Dropout Regularization

Large datasets often have unreliable labels-such as those obtained from ...

Multi-label Co-regularization for Semi-supervised Facial Action Unit Recognition

Facial action units (AUs) recognition is essential for emotion analysis ...

Image Classification with Deep Learning in the Presence of Noisy Labels: A Survey

Image classification systems recently made a big leap with the advanceme...

Toward Robustness against Label Noise in Training Deep Discriminative Neural Networks

Collecting large training datasets, annotated with high-quality labels, ...

Training Convolutional Networks with Noisy Labels

The availability of large labeled datasets has allowed Convolutional Net...

Smart, Deep Copy-Paste

In this work, we propose a novel system for smart copy-paste, enabling t...

Detect, Replace, Refine: Deep Structured Prediction For Pixel Wise Labeling

Pixel wise image labeling is an interesting and challenging problem with...

Please sign up or login with your details

Forgot password? Click here to reset