KNN-enhanced Deep Learning Against Noisy Labels

12/08/2020
by   Shuyu Kong, et al.
8

Supervised learning on Deep Neural Networks (DNNs) is data hungry. Optimizing performance of DNN in the presence of noisy labels has become of paramount importance since collecting a large dataset will usually bring in noisy labels. Inspired by the robustness of K-Nearest Neighbors (KNN) against data noise, in this work, we propose to apply deep KNN for label cleanup. Our approach leverages DNNs for feature extraction and KNN for ground-truth label inference. We iteratively train the neural network and update labels to simultaneously proceed towards higher label recovery rate and better classification performance. Experiment results show that under the same setting, our approach outperforms existing label correction methods and achieves better accuracy on multiple datasets, e.g.,76.78

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/01/2020

Temporal Calibrated Regularization for Robust Noisy Label Learning

Deep neural networks (DNNs) exhibit great success on many tasks with the...
research
01/31/2021

Co-Seg: An Image Segmentation Framework Against Label Corruption

Supervised deep learning performance is heavily tied to the availability...
research
10/11/2020

Is It Time to Redefine the Classification Task for Deep Neural Networks?

Deep neural networks (DNNs) is demonstrated to be vulnerable to the adve...
research
06/27/2022

Towards Harnessing Feature Embedding for Robust Learning with Noisy Labels

The memorization effect of deep neural networks (DNNs) plays a pivotal r...
research
11/25/2020

Delving Deep into Label Smoothing

Label smoothing is an effective regularization tool for deep neural netw...
research
07/03/2020

Increasing Trustworthiness of Deep Neural Networks via Accuracy Monitoring

Inference accuracy of deep neural networks (DNNs) is a crucial performan...
research
03/26/2020

Matrix Smoothing: A Regularization for DNN with Transition Matrix under Noisy Labels

Training deep neural networks (DNNs) in the presence of noisy labels is ...

Please sign up or login with your details

Forgot password? Click here to reset