DeepAI AI Chat
Log In Sign Up

Improving fairness in machine learning systems: What do industry practitioners need?

by   Kenneth Holstein, et al.

The potential for machine learning (ML) systems to amplify social inequities and unfairness is receiving increasing popular and academic attention. A surge of recent work has focused on the development of algorithmic tools to assess and mitigate such unfairness. If these tools are to have a positive impact on industry practice, however, it is crucial that their design be informed by an understanding of real-world needs. Through 35 semi-structured interviews and an anonymous survey of 267 ML practitioners, we conduct the first systematic investigation of commercial product teams' challenges and needs for support in developing fairer ML systems. We identify areas of alignment and disconnect between the challenges faced by industry practitioners and solutions proposed in the fair ML research literature. Based on these findings, we highlight directions for future ML and HCI research that will better address industry practitioners' needs.


Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits

Recent years have seen the development of many open-source ML fairness t...

A Framework for Fairness: A Systematic Review of Existing Fair AI Solutions

In a world of daily emerging scientific inquisition and discovery, the p...

Human Factors in Model Interpretability: Industry Practices, Challenges, and Needs

As the use of machine learning (ML) models in product development and da...

Understanding Machine Learning Practitioners' Data Documentation Perceptions, Needs, Challenges, and Desiderata

Data is central to the development and evaluation of machine learning (M...

Fairness On The Ground: Applying Algorithmic Fairness Approaches to Production Systems

Many technical approaches have been proposed for ensuring that decisions...

Opportunities for Machine Learning to Accelerate Halide Perovskite Commercialization and Scale-Up

While halide perovskites attract significant academic attention, example...

The Grind for Good Data: Understanding ML Practitioners' Struggles and Aspirations in Making Good Data

We thought data to be simply given, but reality tells otherwise; it is c...