A Sparse Nonlinear Classifier Design Using AUC Optimization

12/27/2016
by   Vishal Kakkar, et al.
0

AUC (Area under the ROC curve) is an important performance measure for applications where the data is highly imbalanced. Learning to maximize AUC performance is thus an important research problem. Using a max-margin based surrogate loss function, AUC optimization problem can be approximated as a pairwise rankSVM learning problem. Batch learning methods for solving the kernelized version of this problem suffer from scalability and may not result in sparse classifiers. Recent years have witnessed an increased interest in the development of online or single-pass online learning algorithms that design a classifier by maximizing the AUC performance. The AUC performance of nonlinear classifiers, designed using online methods, is not comparable with that of nonlinear classifiers designed using batch learning algorithms on many real-world datasets. Motivated by these observations, we design a scalable algorithm for maximizing AUC performance by greedily adding the required number of basis functions into the classifier model. The resulting sparse classifiers perform faster inference. Our experimental results show that the level of sparsity achievable can be order of magnitude smaller than the Kernel RankSVM model without affecting the AUC performance much.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/23/2020

Online AUC Optimization for Sparse High-Dimensional Datasets

The Area Under the ROC Curve (AUC) is a widely used performance measure ...
research
01/04/2022

Evolutionary Multitasking AUC Optimization

Learning to optimize the area under the receiver operating characteristi...
research
12/04/2010

Efficient Optimization of Performance Measures by Classifier Adaptation

In practical applications, machine learning algorithms are often needed ...
research
06/02/2023

Does it pay to optimize AUC?

The Area Under the ROC Curve (AUC) is an important model metric for eval...
research
04/23/2019

CPM-sensitive AUC for CTR prediction

The prediction of click-through rate (CTR) is crucial for industrial app...
research
04/15/2023

Robust Educational Dialogue Act Classifiers with Low-Resource and Imbalanced Datasets

Dialogue acts (DAs) can represent conversational actions of tutors or st...
research
11/17/2015

AUC-maximized Deep Convolutional Neural Fields for Sequence Labeling

Deep Convolutional Neural Networks (DCNN) has shown excellent performanc...

Please sign up or login with your details

Forgot password? Click here to reset