Minimax risk classifiers with 0-1 loss

01/17/2022
by   Santiago Mazuelas, et al.
0

Supervised classification techniques use training samples to learn a classification rule with small expected 0-1-loss (error probability). Conventional methods enable tractable learning and provide out-of-sample generalization by using surrogate losses instead of the 0-1-loss and considering specific families of rules (hypothesis classes). This paper presents minimax risk classifiers (MRCs) that minimize the worst-case 0-1-loss over general classification rules and provide tight performance guarantees at learning. We show that MRCs are strongly universally consistent using feature mappings given by characteristic kernels. The paper also proposes efficient optimization techniques for MRC learning and shows that the methods presented can provide accurate classification together with tight performance guarantees

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/15/2020

Minimax Classification with 0-1 Loss and Performance Guarantees

Supervised classification techniques use training samples to find classi...
research
08/04/2021

MRCpy: A Library for Minimax Risk Classifiers

Existing libraries for supervised classification implement techniques th...
research
05/31/2022

Minimax Classification under Concept Drift with Multidimensional Adaptation and Performance Guarantees

The statistical characteristics of instance-label pairs often change wit...
research
02/02/2019

Supervised classification via minimax probabilistic transformations

One of the most common and studied problem in machine learning is classi...
research
10/27/2017

Regularization via Mass Transportation

The goal of regression and classification methods in supervised learning...
research
06/11/2023

Efficient Learning of Minimax Risk Classifiers in High Dimensions

High-dimensional data is common in multiple areas, such as health care a...
research
06/24/2021

Constrained Classification and Policy Learning

Modern machine learning approaches to classification, including AdaBoost...

Please sign up or login with your details

Forgot password? Click here to reset