A Minimax Probability Machine for Non-Decomposable Performance Measures

02/28/2021
by   Junru Luo, et al.
0

Imbalanced classification tasks are widespread in many real-world applications. For such classification tasks, in comparison with the accuracy rate, it is usually much more appropriate to use non-decomposable performance measures such as the Area Under the receiver operating characteristic Curve (AUC) and the F_β measure as the classification criterion since the label class is imbalanced. On the other hand, the minimax probability machine is a popular method for binary classification problems and aims at learning a linear classifier by maximizing the accuracy rate, which makes it unsuitable to deal with imbalanced classification tasks. The purpose of this paper is to develop a new minimax probability machine for the F_β measure, called MPMF, which can be used to deal with imbalanced classification tasks. A brief discussion is also given on how to extend the MPMF model for several other non-decomposable performance measures listed in the paper. To solve the MPMF model effectively, we derive its equivalent form which can then be solved by an alternating descent method to learn a linear classifier. Further, the kernel trick is employed to derive a nonlinear MPMF model to learn a nonlinear classifier. Several experiments on real-world benchmark datasets demonstrate the effectiveness of our new model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/13/2018

Partial AUC Maximization via Nonlinear Scoring Functions

We propose a method for maximizing a partial area under a receiver opera...
research
07/12/2017

Influence of Resampling on Accuracy of Imbalanced Classification

In many real-world binary classification tasks (e.g. detection of certai...
research
03/22/2016

Enhanced perceptrons using contrastive biclusters

Perceptrons are neuronal devices capable of fully discriminating linearl...
research
05/07/2013

A new framework for optimal classifier design

The use of alternative measures to evaluate classifier performance is ga...
research
06/08/2019

Lift Up and Act! Classifier Performance in Resource-Constrained Applications

Classification tasks are common across many fields and applications wher...
research
08/05/2019

Imbalance-XGBoost: Leveraging Weighted and Focal Losses for Binary Label-Imbalanced Classification with XGBoost

The paper presents Imbalance-XGBoost, a Python package that combines the...
research
12/09/2021

A Note on Comparison of F-measures

We comment on a recent TKDE paper "Linear Approximation of F-measure for...

Please sign up or login with your details

Forgot password? Click here to reset