Estimating the class prior and posterior from noisy positives and unlabeled data

06/28/2016
by   Shantanu Jain, et al.
0

We develop a classification algorithm for estimating posterior distributions from positive-unlabeled data, that is robust to noise in the positive labels and effective for high-dimensional data. In recent years, several algorithms have been proposed to learn from positive-unlabeled data; however, many of these contributions remain theoretical, performing poorly on real high-dimensional data that is typically contaminated with noise. We build on this previous work to develop two practical classification algorithms that explicitly model the noise in the positive labels and utilize univariate transforms built on discriminative classifiers. We prove that these univariate transforms preserve the class prior, enabling estimation in the univariate space and avoiding kernel density estimation for high-dimensional data. The theoretical development and both parametric and nonparametric algorithms proposed here constitutes an important step towards wide-spread use of robust classification algorithms for positive-unlabeled data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/08/2016

Nonparametric semi-supervised learning of class proportions

The problem of developing binary classifiers from positive and unlabeled...
research
03/14/2022

Improving State-of-the-Art in One-Class Classification by Leveraging Unlabeled Data

When dealing with binary classification of data with only one labeled cl...
research
10/15/2017

Estimation of Squared-Loss Mutual Information from Positive and Unlabeled Data

Capturing input-output dependency is an important task in statistical da...
research
04/26/2015

Assessing binary classifiers using only positive and unlabeled data

Assessing the performance of a learned model is a crucial part of machin...
research
10/13/2021

Why Out-of-distribution Detection in CNNs Does Not Like Mahalanobis – and What to Use Instead

Convolutional neural networks applied for real-world classification task...
research
10/15/2019

Learning Classifiers on Positive and Unlabeled Data with Policy Gradient

Existing algorithms aiming to learn a binary classifier from positive (P...
research
06/03/2019

Discriminative adversarial networks for positive-unlabeled learning

As an important semi-supervised learning task, positive-unlabeled (PU) l...

Please sign up or login with your details

Forgot password? Click here to reset