A Univariate Bound of Area Under ROC

04/16/2018
by   Siwei Lyu, et al.
0

Area under ROC (AUC) is an important metric for binary classification and bipartite ranking problems. However, it is difficult to directly optimizing AUC as a learning objective, so most existing algorithms are based on optimizing a surrogate loss to AUC. One significant drawback of these surrogate losses is that they require pairwise comparisons among training data, which leads to slow running time and increasing local storage for online learning. In this work, we describe a new surrogate loss based on a reformulation of the AUC risk, which does not require pairwise comparison but rankings of the predictions. We further show that the ranking operation can be avoided, and the learning objective obtained based on this surrogate enjoys linear complexity in time and storage. We perform experiments to demonstrate the effectiveness of the online and batch algorithms for AUC optimization based on the proposed surrogate loss.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/28/2021

Learning with Multiclass AUC: Theory and Algorithms

The Area under the ROC curve (AUC) is a well-known ranking metric for pr...
research
08/03/2012

On the Consistency of AUC Pairwise Optimization

AUC (area under ROC curve) is an important evaluation criterion, which h...
research
01/22/2013

Online Learning with Pairwise Loss Functions

Efficient online learning with pairwise loss functions is a crucial comp...
research
04/17/2023

Enhancing Personalized Ranking With Differentiable Group AUC Optimization

AUC is a common metric for evaluating the performance of a classifier. H...
research
02/28/2019

Novel and Efficient Approximations for Zero-One Loss of Linear Classifiers

The predictive quality of machine learning models is typically measured ...
research
08/25/2015

AUC Optimisation and Collaborative Filtering

In recommendation systems, one is interested in the ranking of the predi...
research
01/05/2021

A Symmetric Loss Perspective of Reliable Machine Learning

When minimizing the empirical risk in binary classification, it is a com...

Please sign up or login with your details

Forgot password? Click here to reset