Blackbox Post-Processing for Multiclass Fairness

01/12/2022
by   Preston Putzel, et al.
0

Applying standard machine learning approaches for classification can produce unequal results across different demographic groups. When then used in real-world settings, these inequities can have negative societal impacts. This has motivated the development of various approaches to fair classification with machine learning models in recent years. In this paper, we consider the problem of modifying the predictions of a blackbox machine learning classifier in order to achieve fairness in a multiclass setting. To accomplish this, we extend the 'post-processing' approach in Hardt et al. 2016, which focuses on fairness for binary classification, to the setting of fair multiclass classification. We explore when our approach produces both fair and accurate predictions through systematic synthetic experiments and also evaluate discrimination-fairness tradeoffs on several publicly available real-world application datasets. We find that overall, our approach produces minor drops in accuracy and enforces fairness when the number of individuals in the dataset is high relative to the number of classes and protected groups.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/14/2022

Achieving Downstream Fairness with Geometric Repair

Consider a scenario where some upstream model developer must train a fai...
research
02/24/2022

Attainability and Optimality: The Equalized Odds Fairness Revisited

Fairness of machine learning algorithms has been of increasing interest....
research
10/03/2018

From Soft Classifiers to Hard Decisions: How fair can we be?

A popular methodology for building binary decision-making classifiers in...
research
05/21/2020

Fair Classification via Unconstrained Optimization

Achieving the Bayes optimal binary classification rule subject to group ...
research
02/21/2020

Learning Fairness-aware Relational Structures

The development of fair machine learning models that effectively avert b...
research
06/15/2022

Beyond Adult and COMPAS: Fairness in Multi-Class Prediction

We consider the problem of producing fair probabilistic classifiers for ...
research
06/19/2022

Fairness-aware Model-agnostic Positive and Unlabeled Learning

With the increasing application of machine learning in high-stake decisi...

Please sign up or login with your details

Forgot password? Click here to reset