Training Convolutional Networks with Noisy Labels

06/09/2014
by   Sainbayar Sukhbaatar, et al.
0

The availability of large labeled datasets has allowed Convolutional Network models to achieve impressive recognition results. However, in many settings manual annotation of the data is impractical; instead our data has noisy labels, i.e. there is some freely available label for each image which may or may not be accurate. In this paper, we explore the performance of discriminatively-trained Convnets when trained on such noisy data. We introduce an extra noise layer into the network which adapts the network outputs to match the noisy label distribution. The parameters of this noise layer can be estimated as part of the training process and involve simple modifications to current training infrastructures for deep networks. We demonstrate the approaches on several datasets, including large scale experiments on the ImageNet classification benchmark.

READ FULL TEXT
research
09/30/2020

Attention-Aware Noisy Label Learning for Image Classification

Deep convolutional neural networks (CNNs) learned on large-scale labeled...
research
05/30/2017

Deep Learning is Robust to Massive Label Noise

Deep neural networks trained on large supervised datasets have led to im...
research
11/12/2013

Visualizing and Understanding Convolutional Networks

Large Convolutional Network models have recently demonstrated impressive...
research
10/26/2019

Model-agnostic Approaches to Handling Noisy Labels When Training Sound Event Classifiers

Label noise is emerging as a pressing issue in sound event classificatio...
research
02/28/2017

Learning Deep Visual Object Models From Noisy Web Data: How to Make it Work

Deep networks thrive when trained on large scale data collections. This ...
research
03/03/2023

When does Privileged Information Explain Away Label Noise?

Leveraging privileged information (PI), or features available during tra...
research
12/20/2014

Training Deep Neural Networks on Noisy Labels with Bootstrapping

Current state-of-the-art deep learning systems for visual object recogni...

Please sign up or login with your details

Forgot password? Click here to reset