Understanding Practices, Challenges, and Opportunities for User-Driven Algorithm Auditing in Industry Practice

10/07/2022
by   Wesley Hanwen Deng, et al.
0

Recent years have seen growing interest among both researchers and practitioners in user-driven approaches to algorithm auditing, which directly engage users in detecting problematic behaviors in algorithmic systems. However, we know little about industry practitioners' current practices and challenges around user-driven auditing, nor what opportunities exist for them to better leverage such approaches in practice. To investigate, we conducted a series of interviews and iterative co-design activities with practitioners who employ user-driven auditing approaches in their work. Our findings reveal several challenges practitioners face in appropriately recruiting and incentivizing user auditors, scaffolding user audits, and deriving actionable insights from user-driven audit reports. Furthermore, practitioners shared organizational obstacles to user-driven auditing, surfacing a complex relationship between practitioners and user auditors. Based on these findings, we discuss opportunities for future HCI research to help realize the potential (and mitigate risks) of user-driven auditing in industry practice.

READ FULL TEXT
research
06/10/2023

Investigating Practices and Opportunities for Cross-functional Collaboration around AI Fairness in Industry Practice

An emerging body of research indicates that ineffective cross-functional...
research
05/13/2022

Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits

Recent years have seen the development of many open-source ML fairness t...
research
04/04/2023

Participation and Division of Labor in User-Driven Algorithm Audits: How Do Everyday Users Work together to Surface Algorithmic Harms?

Recent years have witnessed an interesting phenomenon in which users com...
research
05/06/2021

Everyday algorithm auditing: Understanding the power of everyday users in surfacing harmful algorithmic behaviors

A growing body of literature has proposed formal approaches to audit alg...
research
06/16/2023

Approaching Unanticipated Consequences

In an ever-changing world, even software that fulfils its requirements m...
research
10/01/2018

How UX Practitioners Produce Findings in Usability Testing

Usability testing has long been a core interest of HCI research and form...
research
05/30/2023

GPT Models in Construction Industry: Opportunities, Limitations, and a Use Case Validation

Large Language Models(LLMs) trained on large data sets came into promine...

Please sign up or login with your details

Forgot password? Click here to reset