Fair Inference for Discrete Latent Variable Models

09/15/2022
by   Rashidul Islam, et al.
0

It is now well understood that machine learning models, trained on data without due care, often exhibit unfair and discriminatory behavior against certain populations. Traditional algorithmic fairness research has mainly focused on supervised learning tasks, particularly classification. While fairness in unsupervised learning has received some attention, the literature has primarily addressed fair representation learning of continuous embeddings. In this paper, we conversely focus on unsupervised learning using probabilistic graphical models with discrete latent variables. We develop a fair stochastic variational inference technique for the discrete latent variables, which is accomplished by including a fairness penalty on the variational distribution that aims to respect the principles of intersectionality, a critical lens on fairness from the legal, social science, and humanities literature, and then optimizing the variational parameters under this penalty. We first show the utility of our method in improving equity and fairness for clustering using naïve Bayes and Gaussian mixture models on benchmark datasets. To demonstrate the generality of our approach and its potential for real-world impact, we then develop a special-purpose graphical model for criminal justice risk assessments, and use our fairness approach to prevent the inferences from encoding unfair societal biases.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/09/2013

Accuracy of Latent-Variable Estimation in Bayesian Semi-Supervised Learning

Hierarchical probabilistic models, such as Gaussian mixture models, are ...
research
07/08/2020

Whither Fair Clustering?

Within the relatively busy area of fair machine learning that has been d...
research
08/25/2020

Improving Fair Predictions Using Variational Inference In Causal Models

The importance of algorithmic fairness grows with the increasing impact ...
research
01/23/2013

Inferring Parameters and Structure of Latent Variable Models by Variational Bayes

Current methods for learning graphical models with latent variables and ...
research
06/15/2021

Contrastive Mixture of Posteriors for Counterfactual Inference, Data Integration and Fairness

Learning meaningful representations of data that can address challenges ...
research
06/28/2019

Benefits of Overparameterization in Single-Layer Latent Variable Generative Models

One of the most surprising and exciting discoveries in supervising learn...
research
05/25/2023

Learning Directed Graphical Models with Optimal Transport

Estimating the parameters of a probabilistic directed graphical model fr...

Please sign up or login with your details

Forgot password? Click here to reset