"I had a solid theory before but it's falling apart": Polarizing Effects of Algorithmic Transparency

11/06/2018
by   Aaron Springer, et al.
0

The rise of machine learning has brought closer scrutiny to intelligent systems, leading to calls for greater transparency and explainable algorithms. We explore the effects of transparency on user perceptions of a working intelligent system for emotion detection. In exploratory Study 1, we observed paradoxical effects of transparency which improves perceptions of system accuracy for some participants while reducing accuracy perceptions for others. In Study 2, we test this observation using mixed methods, showing that the apparent transparency paradox can be explained by a mismatch between participant expectations and system predictions. We qualitatively examine this process, indicating that transparency can undermine user confidence by causing users to fixate on flaws when they already have a model of system operation. In contrast transparency helps if users lack such a model. Finally, we revisit the notion of transparency and suggest design considerations for building safe and successful machine learning systems based on our insights.

READ FULL TEXT

page 4

page 8

research
12/07/2018

What Are You Hiding? Algorithmic Transparency and User Perceptions

Extensive recent media focus has been directed towards the dark side of ...
research
11/06/2018

Progressive Disclosure: Designing for Effective Transparency

As we increasingly delegate important decisions to intelligent systems, ...
research
10/24/2022

Good governance and national information transparency: A comparative study of 117 countries

Information transparency is a major building block of responsible govern...
research
09/21/2019

DECoVaC: Design of Experiments with Controlled Variability Components

Reproducible research in Machine Learning has seen a salutary abundance ...
research
04/02/2020

Best Practices for Transparency in Machine Generated Personalization

Machine generated personalization is increasingly used in online systems...
research
01/02/2021

Dimensions of Transparency in NLP Applications

Broader transparency in descriptions of and communication regarding AI s...
research
07/08/2019

Quantifying Transparency of Machine Learning Systems through Analysis of Contributions

Increased adoption and deployment of machine learning (ML) models into b...

Please sign up or login with your details

Forgot password? Click here to reset