Nuanced Metrics for Measuring Unintended Bias with Real Data for Text Classification

03/11/2019
by   Daniel Borkan, et al.
0

Unintended bias in Machine Learning can manifest as systemic differences in performance for different demographic groups, potentially compounding existing challenges to fairness in society at large. In this paper, we introduce a suite of threshold-agnostic metrics that provide a nuanced view of this unintended bias, by considering the various ways that a classifier's score distribution can vary across designated groups. We also introduce a large new test set of online comments with crowd-sourced annotations for identity references. We use this to show how our metrics can be used to find new and potentially subtle unintended bias in existing public models.

READ FULL TEXT

page 7

page 9

research
05/22/2023

On Bias and Fairness in NLP: How to have a fairer text classification?

In this paper, we provide a holistic analysis of the different sources o...
research
08/14/2019

Debiasing Personal Identities in Toxicity Classification

As Machine Learning models continue to be relied upon for making automat...
research
02/08/2023

Local Law 144: A Critical Analysis of Regression Metrics

The use of automated decision tools in recruitment has received an incre...
research
06/28/2021

Quantifying Social Biases in NLP: A Generalization and Empirical Comparison of Extrinsic Fairness Metrics

Measuring bias is key for better understanding and addressing unfairness...
research
08/03/2021

Your fairness may vary: Group fairness of pretrained language models in toxic text classification

We study the performance-fairness trade-off in more than a dozen fine-tu...
research
09/21/2019

Empirical Analysis of Multi-Task Learning for Reducing Model Bias in Toxic Comment Detection

With the recent rise of toxicity in online conversations on social media...
research
04/17/2020

Unsupervised Discovery of Implicit Gender Bias

Despite their prevalence in society, social biases are difficult to defi...

Please sign up or login with your details

Forgot password? Click here to reset