DeepAI
Log In Sign Up

Extending the Machine Learning Abstraction Boundary: A Complex Systems Approach to Incorporate Societal Context

06/17/2020
by   Donald Martin Jr., et al.
0

Machine learning (ML) fairness research tends to focus primarily on mathematically-based interventions on often opaque algorithms or models and/or their immediate inputs and outputs. Such oversimplified mathematical models abstract away the underlying societal context where ML models are conceived, developed, and ultimately deployed. As fairness itself is a socially constructed concept that originates from that societal context along with the model inputs and the models themselves, a lack of an in-depth understanding of societal context can easily undermine the pursuit of ML fairness. In this paper, we outline three new tools to improve the comprehension, identification and representation of societal context. First, we propose a complex adaptive systems (CAS) based model and definition of societal context that will help researchers and product developers to expand the abstraction boundary of ML fairness work to include societal context. Second, we introduce collaborative causal theory formation (CCTF) as a key capability for establishing a sociotechnical frame that incorporates diverse mental models and associated causal theories in modeling the problem and solution space for ML-based products. Finally, we identify community based system dynamics (CBSD) as a powerful, transparent and rigorous approach for practicing CCTF during all phases of the ML product development process. We conclude with a discussion of how these systems theoretic approaches to understand the societal context within which sociotechnical systems are embedded can improve the development of fair and inclusive ML-based products.

READ FULL TEXT

page 1

page 2

page 3

page 4

07/12/2022

Long Term Fairness for Minority Groups via Performative Distributionally Robust Optimization

Fairness researchers in machine learning (ML) have coalesced around seve...
05/15/2020

Participatory Problem Formulation for Fairer Machine Learning Through Community Based System Dynamics

Recent research on algorithmic fairness has highlighted that the problem...
04/20/2020

Games for Fairness and Interpretability

As Machine Learning (ML) systems becomes more ubiquitous, ensuring the f...
03/18/2021

Hidden Technical Debts for Fair Machine Learning in Financial Services

The recent advancements in machine learning (ML) have demonstrated the p...
10/06/2020

Astraea: Grammar-based Fairness Testing

Software often produces biased outputs. In particular, machine learning ...
07/21/2022

GreenDB – A Dataset and Benchmark for Extraction of Sustainability Information of Consumer Goods

The production, shipping, usage, and disposal of consumer goods have a s...
02/17/2020

Simulating Performance of ML Systems with Offline Profiling

We advocate that simulation based on offline profiling is a promising ap...