Partial-Label Regression

06/15/2023
by   Xin Cheng, et al.
0

Partial-label learning is a popular weakly supervised learning setting that allows each training example to be annotated with a set of candidate labels. Previous studies on partial-label learning only focused on the classification setting where candidate labels are all discrete, which cannot handle continuous labels with real values. In this paper, we provide the first attempt to investigate partial-label regression, where each training example is annotated with a set of real-valued candidate labels. To solve this problem, we first propose a simple baseline method that takes the average loss incurred by candidate labels as the predictive loss. The drawback of this method lies in that the loss incurred by the true label may be overwhelmed by other false labels. To overcome this drawback, we propose an identification method that takes the least loss incurred by candidate labels as the predictive loss. We further improve it by proposing a progressive identification method to differentiate candidate labels using progressively updated weights for incurred losses. We prove that the latter two methods are model-consistent and provide convergence analyses. Our proposed methods are theoretically grounded and can be compatible with any models, optimizers, and losses. Experiments validate the effectiveness of our proposed methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/23/2021

Learning with Proper Partial Labels

Partial-label learning is a kind of weakly-supervised learning with inex...
research
06/02/2022

Progressive Purification for Instance-Dependent Partial Label Learning

Partial label learning (PLL) aims to train multi-class classifiers from ...
research
02/19/2020

Progressive Identification of True Labels for Partial-Label Learning

Partial-label learning is one of the important weakly supervised learnin...
research
06/10/2021

Leveraged Weighted Loss for Partial Label Learning

As an important branch of weakly supervised learning, partial label lear...
research
06/11/2021

On the Robustness of Average Losses for Partial-Label Learning

Partial-label (PL) learning is a typical weakly supervised classificatio...
research
07/17/2020

Provably Consistent Partial-Label Learning

Partial-label learning (PLL) is a multi-class classification problem, wh...
research
06/12/2018

Improving Regression Performance with Distributional Losses

There is growing evidence that converting targets to soft targets in sup...

Please sign up or login with your details

Forgot password? Click here to reset