Cohort Shapley value for algorithmic fairness

05/15/2021
by   Masayoshi Mase, et al.
0

Cohort Shapley value is a model-free method of variable importance grounded in game theory that does not use any unobserved and potentially impossible feature combinations. We use it to evaluate algorithmic fairness, using the well known COMPAS recidivism data as our example. This approach allows one to identify for each individual in a data set the extent to which they were adversely or beneficially affected by their value of a protected attribute such as their race. The method can do this even if race was not one of the original predictors and even if it does not have access to a proprietary algorithm that has made the predictions. The grounding in game theory lets us define aggregate variable importance for a data set consistently with its per subject definitions. We can investigate variable importance for multiple quantities of interest in the fairness literature including false positive predictions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/31/2022

Variable importance without impossible data

The most popular methods for measuring importance of the variables in a ...
research
11/08/2018

How Do Fairness Definitions Fare? Examining Public Attitudes Towards Algorithmic Definitions of Fairness

What is the best way to define algorithmic fairness? There has been much...
research
12/08/2019

Towards a Critical Race Methodology in Algorithmic Fairness

We examine the way race and racial categories are adopted in algorithmic...
research
07/31/2018

The Measure and Mismeasure of Fairness: A Critical Review of Fair Machine Learning

In one broad class of supervised machine learning problems, researchers ...
research
03/27/2019

Fairness in Algorithmic Decision Making: An Excursion Through the Lens of Causality

As virtually all aspects of our lives are increasingly impacted by algor...
research
11/01/2019

Explaining black box decisions by Shapley cohort refinement

We introduce a variable importance measure to explain the importance of ...
research
03/23/2020

Absolute Shapley Value

Shapley value is a concept in cooperative game theory for measuring the ...

Please sign up or login with your details

Forgot password? Click here to reset