Factors Influencing Perceived Fairness in Algorithmic Decision-Making: Algorithm Outcomes, Development Procedures, and Individual Differences

01/27/2020
by   Ruotong Wang, et al.
0

Algorithmic decision-making systems are increasingly used throughout the public and private sectors to make important decisions or assist humans in making these decisions with real social consequences. While there has been substantial research in recent years to build fair decision-making algorithms, there has been less research seeking to understand the factors that affect people's perceptions of fairness in these systems, which we argue is also important for their broader acceptance. In this research, we conduct an online experiment to better understand perceptions of fairness, focusing on three sets of factors: algorithm outcomes, algorithm development and deployment procedures, and individual differences. We find that people rate the algorithm as more fair when the algorithm predicts in their favor, even surpassing the negative effects of describing algorithms that are very biased against particular demographic groups. We find that this effect is moderated by several variables, including participants' education level, gender, and several aspects of the development procedure. Our findings suggest that systems that evaluate algorithmic fairness through users' feedback must consider the possibility of outcome favorability bias.

READ FULL TEXT

page 1

page 7

research
02/26/2018

Human Perceptions of Fairness in Algorithmic Decision Making: A Case Study of Criminal Risk Prediction

As algorithms are increasingly used to make important decisions that aff...
research
12/01/2020

Does Fair Ranking Improve Minority Outcomes? Understanding the Interplay of Human and Algorithmic Biases in Online Hiring

Ranking algorithms are being widely employed in various online hiring pl...
research
07/05/2023

Algorithms, Incentives, and Democracy

Classification algorithms are increasingly used in areas such as housing...
research
10/18/2017

Exploiting oddsmaker bias to improve the prediction of NFL outcomes

Accurately predicting the outcome of sporting events has been a goal for...
research
05/02/2020

Dimensions of Diversity in Human Perceptions of Algorithmic Fairness

Algorithms are increasingly involved in making decisions that affect hum...
research
08/26/2022

LUCID: Exposing Algorithmic Bias through Inverse Design

AI systems can create, propagate, support, and automate bias in decision...
research
11/14/2022

A Survey on Preserving Fairness Guarantees in Changing Environments

Human lives are increasingly being affected by the outcomes of automated...

Please sign up or login with your details

Forgot password? Click here to reset