Elucidating Noisy Data via Uncertainty-Aware Robust Learning

11/02/2021
by   Jeongeun Park, et al.
0

Robust learning methods aim to learn a clean target distribution from noisy and corrupted training data where a specific corruption pattern is often assumed a priori. Our proposed method can not only successfully learn the clean target distribution from a dirty dataset but also can estimate the underlying noise pattern. To this end, we leverage a mixture-of-experts model that can distinguish two different types of predictive uncertainty, aleatoric and epistemic uncertainty. We show that the ability to estimate the uncertainty plays a significant role in elucidating the corruption patterns as these two objectives are tightly intertwined. We also present a novel validation scheme for evaluating the performance of the corruption pattern estimation. Our proposed method is extensively assessed in terms of both robustness and corruption pattern estimation through a number of domains, including computer vision and natural language processing.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/06/2023

Pitch Estimation by Denoising Preprocessor and Hybrid Estimation Model

Pitch estimation is to estimate the fundamental frequency and the midi n...
research
05/16/2018

ChoiceNet: Robust Learning by Revealing Output Correlations

In this paper, we focus on the supervised learning problem with corrupte...
research
12/09/2022

Uncertainty Estimation in Deep Speech Enhancement Using Complex Gaussian Mixture Models

Single-channel deep speech enhancement approaches often estimate a singl...
research
07/12/2022

Uncertainty-Aware Learning Against Label Noise on Imbalanced Datasets

Learning against label noise is a vital topic to guarantee a reliable pe...
research
11/03/2021

A Survey on Epistemic (Model) Uncertainty in Supervised Learning: Recent Advances and Applications

Quantifying the uncertainty of supervised learning models plays an impor...
research
09/03/2017

Uncertainty-Aware Learning from Demonstration using Mixture Density Networks with Sampling-Free Variance Modeling

In this paper, we propose an uncertainty-aware learning from demonstrati...
research
05/22/2023

Ambiguity Meets Uncertainty: Investigating Uncertainty Estimation for Word Sense Disambiguation

Word sense disambiguation (WSD), which aims to determine an appropriate ...

Please sign up or login with your details

Forgot password? Click here to reset