On the Resistance of Neural Nets to Label Noise

by   Amnon Drory, et al.

We investigate the behavior of convolutional neural networks (CNN) in the presence of label noise. We show empirically that CNN prediction for a given test sample depends on the labels of the training samples in its local neighborhood. This is similar to the way that the K-nearest neighbors (K-NN) classifier works. With this understanding, we derive an analytical expression for the expected accuracy of a K-NN, and hence a CNN, classifier for any level of noise. In particular, we show that K-NN, and CNN, are resistant to label noise that is randomly spread across the training set, but are very sensitive to label noise that is concentrated. Experiments on real datasets validate our analytical expression by showing that they match the empirical results for varying degrees of label noise.


Local Learning with Deep and Handcrafted Features for Facial Expression Recognition

We present an approach that combines automatic features learned by convo...

Combating Label Noise in Deep Learning Using Abstention

We introduce a novel method to combat label noise when training deep neu...

Supervised Classifiers for Audio Impairments with Noisy Labels

Voice-over-Internet-Protocol (VoIP) calls are prone to various speech im...

kNet: A Deep kNN Network To Handle Label Noise

Deep Neural Networks require large amounts of labeled data for their tra...

Boosting in the presence of label noise

Boosting is known to be sensitive to label noise. We studied two approac...

Neighborhood-based Pooling for Population-level Label Distribution Learning

Supervised machine learning often requires human-annotated data. While a...

Improving Nonparametric Classification via Local Radial Regression with an Application to Stock Prediction

For supervised classification problems, this paper considers estimating ...

Please sign up or login with your details

Forgot password? Click here to reset