Selective Regression Under Fairness Criteria

10/28/2021
by   Abhin Shah, et al.
9

Selective regression allows abstention from prediction if the confidence to make an accurate prediction is not sufficient. In general, by allowing a reject option, one expects the performance of a regression model to increase at the cost of reducing coverage (i.e., by predicting fewer samples). However, as shown in this work, in some cases, the performance of minority group can decrease while we reduce the coverage, and thus selective regression can magnify disparities between different sensitive groups. We show that such an unwanted behavior can be avoided if we can construct features satisfying the sufficiency criterion, so that the mean prediction and the associated uncertainty are calibrated across all the groups. Further, to mitigate the disparity in the performance across groups, we introduce two approaches based on this calibration criterion: (a) by regularizing an upper bound of conditional mutual information under a Gaussian assumption and (b) by regularizing a contrastive loss for mean and uncertainty prediction. The effectiveness of these approaches are demonstrated on synthetic as well as real-world datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/13/2019

Selective prediction-set models with coverage guarantees

Though black-box predictors are state-of-the-art for many complex tasks,...
research
10/27/2020

Selective Classification Can Magnify Disparities Across Groups

Selective classification, in which models are allowed to abstain on unce...
research
03/22/2020

Invariant Rationalization

Selective rationalization improves neural network interpretability by id...
research
05/11/2017

Bayesian Approaches to Distribution Regression

Distribution regression has recently attracted much interest as a generi...
research
01/26/2019

SelectiveNet: A Deep Neural Network with an Integrated Reject Option

We consider the problem of selective prediction (also known as reject op...
research
01/29/2021

Optimal strategies for reject option classifiers

In classification with a reject option, the classifier is allowed in unc...
research
05/23/2019

Leveraging Uncertainty in Deep Learning for Selective Classification

The wide and rapid adoption of deep learning by practitioners brought un...

Please sign up or login with your details

Forgot password? Click here to reset