Learning from Label Proportions by Learning with Label Noise

03/04/2022
by   Jianxin Zhang, et al.
0

Learning from label proportions (LLP) is a weakly supervised classification problem where data points are grouped into bags, and the label proportions within each bag are observed instead of the instance-level labels. The task is to learn a classifier to predict the individual labels of future individual instances. Prior work on LLP for multi-class data has yet to develop a theoretically grounded algorithm. In this work, we provide a theoretically grounded approach to LLP based on a reduction to learning with label noise, using the forward correction (FC) loss of <cit.>. We establish an excess risk bound and generalization error analysis for our approach, while also extending the theory of the FC loss which may be of independent interest. Our approach demonstrates improved empirical performance in deep learning scenarios across multiple datasets and architectures, compared to the leading existing methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/29/2019

Address Instance-level Label Prediction in Multiple Instance Learning

Multiple Instance Learning (MIL) is concerned with learning from bags of...
research
06/12/2020

Learning from Label Proportions: A Mutual Contamination Framework

Learning from label proportions (LLP) is a weakly supervised setting for...
research
07/17/2023

A General Framework for Learning under Corruption: Label Noise, Attribute Noise, and Beyond

Corruption is frequently observed in collected data and has been extensi...
research
02/06/2023

Easy Learning from Label Proportions

We consider the problem of Learning from Label Proportions (LLP), a weak...
research
10/07/2021

Fast learning from label proportions with small bags

In learning from label proportions (LLP), the instances are grouped into...
research
09/13/2016

Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approach

We present a theoretically grounded approach to train deep neural networ...
research
05/16/2023

Learning from Aggregated Data: Curated Bags versus Random Bags

Protecting user privacy is a major concern for many machine learning sys...

Please sign up or login with your details

Forgot password? Click here to reset