DeepAI AI Chat
Log In Sign Up

Information Theoretic Measures for Fairness-aware Feature Selection

06/01/2021
by   Sajad Khodadadian, et al.
0

Machine learning algorithms are increasingly used for consequential decision making regarding individuals based on their relevant features. Features that are relevant for accurate decisions may however lead to either explicit or implicit forms of discrimination against unprivileged groups, such as those of certain race or gender. This happens due to existing biases in the training data, which are often replicated or even exacerbated by the learning algorithm. Identifying and measuring these biases at the data level is a challenging problem due to the interdependence among the features, and the decision outcome. In this work, we develop a framework for fairness-aware feature selection which takes into account the correlation among the features and the decision outcome, and is based on information theoretic measures for the accuracy and discriminatory impacts of features. In particular, we first propose information theoretic measures which quantify the impact of different subsets of features on the accuracy and discrimination of the decision outcomes. We then deduce the marginal impact of each feature using Shapley value function; a solution concept in cooperative game theory used to estimate marginal contributions of players in a coalitional game. Finally, we design a fairness utility score for each feature (for feature selection) which quantifies how this feature influences accurate as well as nondiscriminatory decisions. Our framework depends on the joint statistics of the data rather than a particular classifier design. We examine our proposed framework on real and synthetic data to evaluate its performance.

READ FULL TEXT
04/30/2022

Fair Feature Subset Selection using Multiobjective Genetic Algorithm

The feature subset selection problem aims at selecting the relevant subs...
07/13/2021

Fairness-aware Summarization for Justified Decision-Making

In many applications such as recidivism prediction, facility inspection,...
12/10/2021

Interaction-Aware Sensitivity Analysis for Aerodynamic Optimization Results using Information Theory

An important issue during an engineering design process is to develop an...
10/12/2019

Measuring Unfairness through Game-Theoretic Interpretability

One often finds in the literature connections between measures of fairne...
05/17/2020

The Role of Randomness and Noise in Strategic Classification

We investigate the problem of designing optimal classifiers in the strat...
01/16/2018

On the Direction of Discrimination: An Information-Theoretic Analysis of Disparate Impact in Machine Learning

In the context of machine learning, disparate impact refers to a form of...
10/05/2021

Feature Selection by a Mechanism Design

In constructing an econometric or statistical model, we pick relevant fe...