On the Within-Group Discrimination of Screening Classifiers

01/31/2023
by   Nastaran Okati, et al.
0

Screening classifiers are increasingly used to identify qualified candidates in a variety of selection processes. In this context, it has been recently shown that, if a classifier is calibrated, one can identify the smallest set of candidates which contains, in expectation, a desired number of qualified candidates using a threshold decision rule. This lends support to focusing on calibration as the only requirement for screening classifiers. In this paper, we argue that screening policies that use calibrated classifiers may suffer from an understudied type of within-group discrimination – they may discriminate against qualified members within demographic groups of interest. Further, we argue that this type of discrimination can be avoided if classifiers satisfy within-group monotonicity, a natural monotonicity property within each of the groups. Then, we introduce an efficient post-processing algorithm based on dynamic programming to minimally modify a given calibrated classifier so that its probability estimates satisfy within-group monotonicity. We validate our algorithm using US Census survey data and show that within-group monotonicity can be often achieved at a small cost in terms of prediction granularity and shortlist size.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/02/2022

Improving Screening Processes via Calibrated Subset Selection

Many selection processes such as finding patients qualifying for a medic...
research
01/14/2014

Binary Classifier Calibration: Non-parametric approach

Accurate calibration of probabilistic predictive models learned is criti...
research
10/03/2018

From Soft Classifiers to Hard Decisions: How fair can we be?

A popular methodology for building binary decision-making classifiers in...
research
12/10/2021

On Fair Selection in the Presence of Implicit and Differential Variance

Discrimination in selection problems such as hiring or college admission...
research
07/28/2023

The Initial Screening Order Problem

In this paper we present the initial screening order problem, a crucial ...
research
03/14/2022

Multi Stage Screening: Enforcing Fairness and Maximizing Efficiency in a Pre-Existing Pipeline

Consider an actor making selection decisions using a series of classifie...
research
05/27/2019

Efficient candidate screening under multiple tests and implications for fairness

When recruiting job candidates, employers rarely observe their underlyin...

Please sign up or login with your details

Forgot password? Click here to reset