DeepAI AI Chat
Log In Sign Up

Delayed Impact of Fair Machine Learning

03/12/2018
by   Lydia T. Liu, et al.
0

Fairness in machine learning has predominantly been studied in static classification settings without concern for how decisions change the underlying population over time. Conventional wisdom suggests that fairness criteria promote the long-term well-being of those groups they aim to protect. We study how static fairness criteria interact with temporal indicators of well-being, such as long-term improvement, stagnation, and decline in a variable of interest. We demonstrate that even in a one-step feedback model, common fairness criteria in general do not promote improvement over time, and may in fact cause harm in cases where an unconstrained objective would not. We completely characterize the delayed impact of three standard criteria, contrasting the regimes in which these exhibit qualitatively different behavior. In addition, we find that a natural form of measurement error broadens the regime in which fairness criteria perform favorably. Our results highlight the importance of measurement and temporal modeling in the evaluation of fairness criteria, suggesting a range of new challenges and trade-offs.

READ FULL TEXT

page 7

page 16

07/12/2022

Long Term Fairness for Minority Groups via Performative Distributionally Robust Optimization

Fairness researchers in machine learning (ML) have coalesced around seve...
10/21/2020

How Do Fair Decisions Fare in Long-term Qualification?

Although many fairness criteria have been proposed for decision making, ...
10/13/2022

Equal Improvability: A New Fairness Notion Considering the Long-term Impact

Devising a fair classifier that does not discriminate against different ...
08/24/2022

Enforcing Delayed-Impact Fairness Guarantees

Recent research has shown that seemingly fair machine learning models, w...
03/17/2020

Fair inference on error-prone outcomes

Fair inference in supervised learning is an important and active area of...
08/17/2022

Long-term dynamics of fairness: understanding the impact of data-driven targeted help on job seekers

The use of data-driven decision support by public agencies is becoming m...