Minimax Classification with 0-1 Loss and Performance Guarantees

10/15/2020
by   Santiago Mazuelas, et al.
0

Supervised classification techniques use training samples to find classification rules with small expected 0-1 loss. Conventional methods achieve efficient learning and out-of-sample generalization by minimizing surrogate losses over specific families of rules. This paper presents minimax risk classifiers (MRCs) that do not rely on a choice of surrogate loss and family of rules. MRCs achieve efficient learning and out-of-sample generalization by minimizing worst-case expected 0-1 loss w.r.t. uncertainty sets that are defined by linear constraints and include the true underlying distribution. In addition, MRCs' learning stage provides performance guarantees as lower and upper tight bounds for expected 0-1 loss. We also present MRCs' finite-sample generalization bounds in terms of training size and smallest minimax risk, and show their competitive classification performance w.r.t. state-of-the-art techniques using benchmark datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/17/2022

Minimax risk classifiers with 0-1 loss

Supervised classification techniques use training samples to learn a cla...
research
02/02/2019

Supervised classification via minimax probabilistic transformations

One of the most common and studied problem in machine learning is classi...
research
05/31/2022

Minimax Classification under Concept Drift with Multidimensional Adaptation and Performance Guarantees

The statistical characteristics of instance-label pairs often change wit...
research
08/04/2021

MRCpy: A Library for Minimax Risk Classifiers

Existing libraries for supervised classification implement techniques th...
research
06/07/2016

A Minimax Approach to Supervised Learning

Given a task of predicting Y from X, a loss function L, and a set of pro...
research
09/14/2018

Efficient Structured Surrogate Loss and Regularization in Structured Prediction

In this dissertation, we focus on several important problems in structur...
research
10/26/2021

Boosted CVaR Classification

Many modern machine learning tasks require models with high tail perform...

Please sign up or login with your details

Forgot password? Click here to reset