A Distributionally Robust Area Under Curve Maximization Model

02/18/2020
by   Wenbo Ma, et al.
0

Area under ROC curve (AUC) is a widely used performance measure for classification models. We propose a new distributionally robust AUC maximization model (DR-AUC) that relies on the Kantorovich metric and approximates the AUC with the hinge loss function. We use duality theory to reformulate the DR-AUC model as a tractable convex quadratic optimization problem. The numerical experiments show that the proposed DR-AUC model – benchmarked with the standard deterministic AUC and the support vector machine models - improves the out-of-sample performance over the majority of the considered datasets. The results are particularly encouraging since our numerical experiments are conducted with training sets of small size which have been known to be conducive to low out-of-sample performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/13/2016

Support Vector Algorithms for Optimizing the Partial Area Under the ROC Curve

The area under the ROC curve (AUC) is a widely used performance measure ...
research
06/14/2019

Stochastic Proximal AUC Maximization

In this paper we consider the problem of maximizing the Area under the R...
research
05/29/2023

The Misuse of AUC: What High Impact Risk Assessment Gets Wrong

When determining which machine learning model best performs some high im...
research
05/21/2021

Computational Efficient Approximations of the Concordance Probability in a Big Data Setting

Performance measurement is an essential task once a statistical model is...
research
02/24/2020

Revisiting Saliency Metrics: Farthest-Neighbor Area Under Curve

Saliency detection has been widely studied because it plays an important...
research
11/16/2015

Efficient AUC Optimization for Information Ranking Applications

Adequate evaluation of an information retrieval system to estimate futur...
research
08/10/2020

Predicting Risk of Developing Diabetic Retinopathy using Deep Learning

Diabetic retinopathy (DR) screening is instrumental in preventing blindn...

Please sign up or login with your details

Forgot password? Click here to reset