DeepAI AI Chat
Log In Sign Up

"A cold, technical decision-maker": Can AI provide explainability, negotiability, and humanity?

by   Allison Woodruff, et al.

Algorithmic systems are increasingly deployed to make decisions in many areas of people's lives. The shift from human to algorithmic decision-making has been accompanied by concern about potentially opaque decisions that are not aligned with social values, as well as proposed remedies such as explainability. We present results of a qualitative study of algorithmic decision-making, comprised of five workshops conducted with a total of 60 participants in Finland, Germany, the United Kingdom, and the United States. We invited participants to reason about decision-making qualities such as explainability and accuracy in a variety of domains. Participants viewed AI as a decision-maker that follows rigid criteria and performs mechanical tasks well, but is largely incapable of subjective or morally complex judgments. We discuss participants' consideration of humanity in decision-making, and introduce the concept of 'negotiability,' the ability to go beyond formal criteria and work flexibly around the system.


page 1

page 2

page 3

page 4


Expanding Explainability: Towards Social Transparency in AI systems

As AI-powered systems increasingly mediate consequential decision-making...

Conceptualising Contestability: Perspectives on Contesting Algorithmic Decisions

As the use of algorithmic systems in high-stakes decision-making increas...

The Conflict Between Explainable and Accountable Decision-Making Algorithms

Decision-making algorithms are being used in important decisions, such a...

Learning When to Advise Human Decision Makers

Artificial intelligence (AI) systems are increasingly used for providing...

Covert Embodied Choice: Decision-Making and the Limits of Privacy Under Biometric Surveillance

Algorithms engineered to leverage rich behavioral and biometric data to ...

Understanding the Effects of Visualizing Missing Values on Visual Data Exploration

When performing data analysis, people often confront data sets containin...

Theoretical, Measured and Subjective Responsibility in Aided Decision Making

AI and advanced automation are involved in almost all aspects of our lif...