DeepAI AI Chat
Log In Sign Up

Multi Stage Screening: Enforcing Fairness and Maximizing Efficiency in a Pre-Existing Pipeline

03/14/2022
by   Avrim Blum, et al.
Toyota Technological Institute at Chicago
4

Consider an actor making selection decisions using a series of classifiers, which we term a sequential screening process. The early stages filter out some applicants, and in the final stage an expensive but accurate test is applied to the individuals that make it to the final stage. Since the final stage is expensive, if there are multiple groups with different fractions of positives at the penultimate stage (even if a slight gap), then the firm may naturally only choose to the apply the final (interview) stage solely to the highest precision group which would be clearly unfair to the other groups. Even if the firm is required to interview all of those who pass the final round, the tests themselves could have the property that qualified individuals from some groups pass more easily than qualified individuals from others. Thus, we consider requiring Equality of Opportunity (qualified individuals from each each group have the same chance of reaching the final stage and being interviewed). We then examine the goal of maximizing quantities of interest to the decision maker subject to this constraint, via modification of the probabilities of promotion through the screening process at each stage based on performance at the previous stage. We exhibit algorithms for satisfying Equal Opportunity over the selection process and maximizing precision (the fraction of interview that yield qualified candidates) as well as linear combinations of precision and recall (recall determines the number of applicants needed per hire) at the end of the final stage. We also present examples showing that the solution space is non-convex, which motivate our exact and (FPTAS) approximation algorithms for maximizing the linear combination of precision and recall. Finally, we discuss the `price of' adding additional restrictions, such as not allowing the decision maker to use group membership in its decision process.

READ FULL TEXT

page 1

page 2

page 3

page 4

06/05/2022

Enforcing Group Fairness in Algorithmic Decision Making: Utility Maximization Under Sufficiency

Binary decision making classifiers are not fair by default. Fairness req...
06/15/2019

The Price of Local Fairness in Multistage Selection

The rise of algorithmic decision making led to active researches on how ...
11/15/2019

Optimal adaptive group testing

The group testing problem is concerned with identifying a small number k...
01/13/2018

On a statistical approach to mate choices in reproduction

We provide a probabilistic approach to modeling the movements of subject...
01/31/2023

On the Within-Group Discrimination of Screening Classifiers

Screening classifiers are increasingly used to identify qualified candid...
06/01/2020

Multi-Stage Transfer Learning with an Application to Selection Process

In multi-stage processes, decisions happen in an ordered sequence of sta...
04/02/2021

A Comparison of Similarity Based Instance Selection Methods for Cross Project Defect Prediction

Context: Previous studies have shown that training data instance selecti...