`It is currently hodgepodge”: Examining AI/ML Practitioners' Challenges during Co-production of Responsible AI Values

07/14/2023
by   Rama Adithya Varanasi, et al.
0

Recently, the AI/ML research community has indicated an urgent need to establish Responsible AI (RAI) values and practices as part of the AI/ML lifecycle. Several organizations and communities are responding to this call by sharing RAI guidelines. However, there are gaps in awareness, deliberation, and execution of such practices for multi-disciplinary ML practitioners. This work contributes to the discussion by unpacking co-production challenges faced by practitioners as they align their RAI values. We interviewed 23 individuals, across 10 organizations, tasked to ship AI/ML based products while upholding RAI norms and found that both top-down and bottom-up institutional structures create burden for different roles preventing them from upholding RAI values, a challenge that is further exacerbated when executing conflicted values. We share multiple value levers used as strategies by the practitioners to resolve their challenges. We end our paper with recommendations for inclusive and equitable RAI value-practices, creating supportive organizational structures and opportunities to further aid practitioners.

READ FULL TEXT
research
06/22/2020

Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for shifting Organizational Practices

Large and ever-evolving industry organizations continue to invest more t...
research
10/06/2021

Machine Learning Practices Outside Big Tech: How Resource Constraints Challenge Responsible Development

Practitioners from diverse occupations and backgrounds are increasingly ...
research
05/16/2022

How Different Groups Prioritize Ethical Values for Responsible AI

Private companies, public sector organizations, and academic groups have...
research
02/28/2022

The Golden Circle: Creating Socio-technical Alignment in Content Moderation

This paper outlines a conceptual framework titled The Golden Circle that...
research
05/09/2022

Towards a multi-stakeholder value-based assessment framework for algorithmic systems

In an effort to regulate Machine Learning-driven (ML) systems, current a...
research
03/21/2022

Whose AI Dream? In search of the aspiration in data annotation

This paper present the practice of data annotation from the perspective ...
research
05/10/2022

Social Inclusion in Curated Contexts: Insights from Museum Practices

Artificial intelligence literature suggests that minority and fragile co...

Please sign up or login with your details

Forgot password? Click here to reset