Learning from Multiple Annotator Noisy Labels via Sample-wise Label Fusion

07/22/2022
by   Zhengqi Gao, et al.
10

Data lies at the core of modern deep learning. The impressive performance of supervised learning is built upon a base of massive accurately labeled data. However, in some real-world applications, accurate labeling might not be viable; instead, multiple noisy labels (instead of one accurate label) are provided by several annotators for each data sample. Learning a classifier on such a noisy training dataset is a challenging task. Previous approaches usually assume that all data samples share the same set of parameters related to annotator errors, while we demonstrate that label error learning should be both annotator and data sample dependent. Motivated by this observation, we propose a novel learning algorithm. The proposed method displays superiority compared with several state-of-the-art baseline methods on MNIST, CIFAR-100, and ImageNet-100. Our code is available at: https://github.com/zhengqigao/Learning-from-Multiple-Annotator-Noisy-Labels.

READ FULL TEXT

page 5

page 8

research
03/08/2022

Trustable Co-label Learning from Multiple Noisy Annotators

Supervised deep learning depends on massive accurately annotated example...
research
06/04/2019

The Extended Dawid-Skene Model: Fusing Information from Multiple Data Schemas

While label fusion from multiple noisy annotations is a well understood ...
research
12/02/2022

Model and Data Agreement for Learning with Noisy Labels

Learning with noisy labels is a vital topic for practical deep learning ...
research
02/15/2021

One Line To Rule Them All: Generating LO-Shot Soft-Label Prototypes

Increasingly large datasets are rapidly driving up the computational cos...
research
12/05/2020

A Survey on Deep Learning with Noisy Labels: How to train your model when you cannot trust on the annotations?

Noisy Labels are commonly present in data sets automatically collected f...
research
10/05/2020

Automatic label correction based on CCESD

In the computer-aided diagnosis of cervical precancerous lesions, it is ...
research
04/12/2023

Label-Free Concept Bottleneck Models

Concept bottleneck models (CBM) are a popular way of creating more inter...

Please sign up or login with your details

Forgot password? Click here to reset