FADE: FAir Double Ensemble Learning for Observable and Counterfactual Outcomes

09/01/2021
by   Alan Mishler, et al.
0

Methods for building fair predictors often involve tradeoffs between fairness and accuracy and between different fairness criteria, but the nature of these tradeoffs varies. Recent work seeks to characterize these tradeoffs in specific problem settings, but these methods often do not accommodate users who wish to improve the fairness of an existing benchmark model without sacrificing accuracy, or vice versa. These results are also typically restricted to observable accuracy and fairness criteria. We develop a flexible framework for fair ensemble learning that allows users to efficiently explore the fairness-accuracy space or to improve the fairness or accuracy of a benchmark model. Our framework can simultaneously target multiple observable or counterfactual fairness criteria, and it enables users to combine a large number of previously trained and newly trained predictors. We provide theoretical guarantees that our estimators converge at fast rates. We apply our method on both simulated and real data, with respect to both observable and counterfactual accuracy and fairness criteria. We show that, surprisingly, multiple unfairness measures can sometimes be minimized simultaneously with little impact on accuracy, relative to unconstrained predictors or existing benchmark models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/10/2022

Fair When Trained, Unfair When Deployed: Observable Fairness Measures are Unstable in Performative Prediction Settings

Many popular algorithmic fairness measures depend on the joint distribut...
research
03/17/2020

Fair inference on error-prone outcomes

Fair inference in supervised learning is an important and active area of...
research
11/15/2019

Fair Data Adaptation with Quantile Preservation

Fairness of classification and regression has received much attention re...
research
09/07/2020

Fairness in Risk Assessment Instruments: Post-Processing to Achieve Counterfactual Equalized Odds

Algorithmic fairness is a topic of increasing concern both within resear...
research
05/26/2019

Equal Opportunity and Affirmative Action via Counterfactual Predictions

Machine learning (ML) can automate decision-making by learning to predic...
research
11/08/2021

Identifying Best Fair Intervention

We study the problem of best arm identification with a fairness constrai...
research
02/13/2018

A comparative study of fairness-enhancing interventions in machine learning

Computers are increasingly used to make decisions that have significant ...

Please sign up or login with your details

Forgot password? Click here to reset