Neyman-Pearson Multi-class Classification via Cost-sensitive Learning

11/08/2021
by   Ye Tian, et al.
0

Most existing classification methods aim to minimize the overall misclassification error rate, however, in applications, different types of errors can have different consequences. To take into account this asymmetry issue, two popular paradigms have been developed, namely the Neyman-Pearson (NP) paradigm and cost-sensitive (CS) paradigm. Compared to CS paradigm, NP paradigm does not require a specification of costs. Most previous works on NP paradigm focused on the binary case. In this work, we study the multi-class NP problem by connecting it to the CS problem, and propose two algorithms. We extend the NP oracle inequalities and consistency from the binary case to the multi-class case, and show that our two algorithms enjoy these properties under certain conditions. The simulation and real data studies demonstrate the effectiveness of our algorithms. To our knowledge, this is the first work to solve the multi-class NP problem via cost-sensitive learning techniques with theoretical guarantees. The proposed algorithms are implemented in the R package "npcs" on CRAN.

READ FULL TEXT

page 18

page 20

research
08/13/2015

Neyman-Pearson Classification under High-Dimensional Settings

Most existing binary classification methods target on the optimization o...
research
01/01/2015

Consistent Classification Algorithms for Multi-class Non-Decomposable Performance Metrics

We study consistency of learning algorithms for a multi-class performanc...
research
02/07/2018

Sparse Linear Discriminant Analysis under the Neyman-Pearson Paradigm

In contrast to the classical binary classification paradigm that minimiz...
research
09/18/2023

New Bounds on the Accuracy of Majority Voting for Multi-Class Classification

Majority voting is a simple mathematical function that returns the value...
research
05/24/2019

A Generalization Error Bound for Multi-class Domain Generalization

Domain generalization is the problem of assigning labels to an unlabeled...
research
03/07/2023

Scatter-based common spatial patterns – a unified spatial filtering framework

The common spatial pattern (CSP) approach is known as one of the most po...
research
06/17/2020

A two-dimensional multi-class traffic flow model

The aim of this work is to introduce a two-dimensional macroscopic traff...

Please sign up or login with your details

Forgot password? Click here to reset