Learning from Noisy Labels with Deep Neural Networks: A Survey

07/16/2020
by   Hwanjun Song, et al.
0

Deep learning has achieved remarkable success in numerous domains with help from large amounts of big data. However, the quality of data labels is a concern because of the lack of high-quality labels in many real-world scenarios. As noisy labels severely degrade the generalization performance of deep neural networks, learning from noisy labels (robust training) is becoming an important task in modern deep learning applications. In this survey, we first describe the problem of learning with label noise from a supervised learning perspective. Next, we provide a comprehensive review of 46 state-of-the-art robust training methods, all of which are categorized into seven groups according to their methodological difference, followed by a systematic comparison of six properties used to evaluate their superiority. Subsequently, we summarize the typically used evaluation methodology, including public noisy datasets and evaluation metrics. Finally, we present several promising research directions that can serve as a guideline for future studies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/11/2019

Image Classification with Deep Learning in the Presence of Noisy Labels: A Survey

Image classification systems recently made a big leap with the advanceme...
research
11/09/2020

A Survey of Label-noise Representation Learning: Past, Present and Future

Classical machine learning implicitly assumes that labels of the trainin...
research
03/21/2023

Fighting over-fitting with quantization for learning deep neural networks on noisy labels

The rising performance of deep neural networks is often empirically attr...
research
06/17/2021

Towards Understanding Deep Learning from Noisy Labels with Small-Loss Criterion

Deep neural networks need large amounts of labeled data to achieve good ...
research
11/02/2017

Deep Learning from Noisy Image Labels with Quality Embedding

There is an emerging trend to leverage noisy image datasets in many visu...
research
07/10/2023

Robust Feature Learning Against Noisy Labels

Supervised learning of deep neural networks heavily relies on large-scal...
research
01/02/2019

A Survey on Multi-output Learning

Multi-output learning aims to simultaneously predict multiple outputs gi...

Please sign up or login with your details

Forgot password? Click here to reset