Positive-Unlabeled Learning with Non-Negative Risk Estimator

03/02/2017
by   Ryuichi Kiryo, et al.
0

From only positive (P) and unlabeled (U) data, a binary classifier could be trained with PU learning, in which the state of the art is unbiased PU learning. However, if its model is very flexible, empirical risks on training data will go negative, and we will suffer from serious overfitting. In this paper, we propose a non-negative risk estimator for PU learning: when getting minimized, it is more robust against overfitting, and thus we are able to use very flexible models (such as deep neural networks) given limited P data. Moreover, we analyze the bias, consistency, and mean-squared-error reduction of the proposed risk estimator, and bound the estimation error of the resulting empirical risk minimizer. Experiments demonstrate that our risk estimator fixes the overfitting problem of its unbiased counterparts.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/20/2019

Mitigating Overfitting in Supervised Classification from Two Unlabeled Datasets: A Consistent Risk Correction Approach

From two unlabeled (U) datasets with different class priors, we can trai...
research
07/04/2022

Learning from Multiple Unlabeled Datasets with Partial Risk Regularization

Recent years have witnessed a great success of supervised deep learning,...
research
11/21/2021

Deep Image Prior using Stein's Unbiased Risk Estimator: SURE-DIP

Deep learning algorithms that rely on extensive training data are revolu...
research
07/01/2016

A new analytical approach to consistency and overfitting in regularized empirical risk minimization

This work considers the problem of binary classification: given training...
research
10/21/2019

An Unbiased Risk Estimator for Learning with Augmented Classes

In this paper, we study the problem of learning with augmented classes (...
research
09/22/2017

On overfitting and asymptotic bias in batch reinforcement learning with partial observability

This paper stands in the context of reinforcement learning with partial ...
research
07/05/2020

Unbiased Risk Estimators Can Mislead: A Case Study of Learning with Complementary Labels

In weakly supervised learning, unbiased risk estimator(URE) is a powerfu...

Please sign up or login with your details

Forgot password? Click here to reset