Prediction and estimation consistency of sparse multi-class penalized optimal scoring

09/12/2018
by   Irina Gaynanova, et al.
0

Sparse linear discriminant analysis via penalized optimal scoring is a successful tool for classification in high-dimensional settings. While the variable selection consistency of sparse optimal scoring has been established, the corresponding prediction and estimation consistency results have been lacking. We bridge this gap by providing probabilistic bounds on out-of-sample prediction error and estimation error of multi-class penalized optimal scoring allowing for diverging number of classes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/27/2012

An Efficient Approach to Sparse Linear Discriminant Analysis

We present a novel approach to the formulation and the resolution of spa...
research
06/25/2013

Supersparse Linear Integer Models for Predictive Scoring Systems

We introduce Supersparse Linear Integer Models (SLIM) as a tool to creat...
research
04/11/2023

Learning Optimal Fair Scoring Systems for Multi-Class Classification

Machine Learning models are increasingly used for decision making, in pa...
research
06/27/2013

Optimal Feature Selection in High-Dimensional Discriminant Analysis

We consider the high-dimensional discriminant analysis problem. For this...
research
12/28/2017

Sorted Concave Penalized Regression

The Lasso is biased. Concave penalized least squares estimation (PLSE) t...
research
02/18/2020

Consistency of ℓ _1 Penalized Negative Binomial Regressions

We prove the consistency of the ℓ_1 penalized negative binomial regressi...
research
11/18/2017

Prediction Scores as a Window into Classifier Behavior

Most multi-class classifiers make their prediction for a test sample by ...

Please sign up or login with your details

Forgot password? Click here to reset