A Locally Adaptive Shrinkage Approach to False Selection Rate Control in High-Dimensional Classification

10/09/2022
by   Bowen Gang, et al.
0

The uncertainty quantification and error control of classifiers are crucial in many high-consequence decision-making scenarios. We propose a selective classification framework that provides an indecision option for any observations that cannot be classified with confidence. The false selection rate (FSR), defined as the expected fraction of erroneous classifications among all definitive classifications, provides a useful error rate notion that trades off a fraction of indecisions for fewer classification errors. We develop a new class of locally adaptive shrinkage and selection (LASS) rules for FSR control in the context of high-dimensional linear discriminant analysis (LDA). LASS is easy-to-analyze and has robust performance across sparse and dense regimes. Theoretical guarantees on FSR control are established without strong assumptions on sparsity as required by existing theories in high-dimensional LDA. The empirical performances of LASS are investigated using both simulated and real data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/09/2022

Error-based Knockoffs Inference for Controlled Feature Selection

Recently, the scheme of model-X knockoffs was proposed as a promising so...
research
12/25/2018

Optimal False Discovery Control of Minimax Estimator

In the analysis of high dimensional regression models, there are two imp...
research
06/16/2021

Nonparametric Empirical Bayes Estimation and Testing for Sparse and Heteroscedastic Signals

Large-scale modern data often involves estimation and testing for high-d...
research
04/09/2018

High-dimensional Linear Discriminant Analysis: Optimality, Adaptive Algorithm, and Missing Data

This paper aims to develop an optimality theory for linear discriminant ...
research
09/17/2015

Sparse Fisher's Linear Discriminant Analysis for Partially Labeled Data

Classification is an important tool with many useful applications. Among...
research
07/05/2021

Hierarchical clustered multiclass discriminant analysis via cross-validation

Linear discriminant analysis (LDA) is a well-known method for multiclass...
research
05/20/2017

Calibrating Black Box Classification Models through the Thresholding Method

In high-dimensional classification settings, we wish to seek a balance b...

Please sign up or login with your details

Forgot password? Click here to reset