Meta Transition Adaptation for Robust Deep Learning with Noisy Labels

06/10/2020
by   Jun Shu, et al.
2

To discover intrinsic inter-class transition probabilities underlying data, learning with noise transition has become an important approach for robust deep learning on corrupted labels. Prior methods attempt to achieve such transition knowledge by pre-assuming strongly confident anchor points with 1-probability belonging to a specific class, generally infeasible in practice, or directly jointly estimating the transition matrix and learning the classifier from the noisy samples, always leading to inaccurate estimation misguided by wrong annotation information especially in large noise cases. To alleviate these issues, this study proposes a new meta-transition-learning strategy for the task. Specifically, through the sound guidance of a small set of meta data with clean labels, the noise transition matrix and the classifier parameters can be mutually ameliorated to avoid being trapped by noisy training samples, and without need of any anchor point assumptions. Besides, we prove our method is with statistical consistency guarantee on correctly estimating the desired transition matrix. Extensive synthetic and real experiments validate that our method can more accurately extract the transition matrix, naturally following its more robust performance than prior arts. Its essential relationship with label distribution learning is also discussed, which explains its fine performance even under no-noise scenarios.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/16/2022

Instance-specific Label Distribution Regularization for Learning with Label Noise

Modeling noise transition matrix is a kind of promising method for learn...
research
06/01/2019

Are Anchor Points Really Indispensable in Label-Noise Learning?

In label-noise learning, noise transition matrix, denoting the probabili...
research
03/06/2019

Safeguarded Dynamic Label Regression for Generalized Noisy Supervision

Learning with noisy labels, which aims to reduce expensive labors on acc...
research
02/19/2023

Latent Class-Conditional Noise Model

Learning with noisy labels has become imperative in the Big Data era, wh...
research
11/29/2021

Learning with Noisy Labels by Efficient Transition Matrix Estimation to Combat Label Miscorrection

Recent studies on learning with noisy labels have shown remarkable perfo...
research
02/04/2021

Provably End-to-end Label-Noise Learning without Anchor Points

In label-noise learning, the transition matrix plays a key role in build...
research
01/14/2019

How Does Disagreement Benefit Co-teaching?

Learning with noisy labels is one of the most important question in weak...

Please sign up or login with your details

Forgot password? Click here to reset