Does Explainable Artificial Intelligence Improve Human Decision-Making?

06/19/2020
by   Yasmeen Alufaisan, et al.
0

Explainable AI provides insight into the "why" for model predictions, offering potential for users to better understand and trust a model, and to recognize and correct AI predictions that are incorrect. Prior research on human and explainable AI interactions has focused on measures such as interpretability, trust, and usability of the explanation. Whether explainable AI can improve actual human decision-making and the ability to identify the problems with the underlying model are open questions. Using real datasets, we compare and evaluate objective human decision accuracy without AI (control), with an AI prediction (no explanation), and AI prediction with explanation. We find providing any kind of AI prediction tends to improve user decision accuracy, but no conclusive evidence that explainable AI has a meaningful impact. Moreover, we observed the strongest predictor for human decision accuracy was AI accuracy and that users were somewhat able to detect when the AI was correct versus incorrect, but this was not significantly affected by including an explanation. Our results indicate that, at least in some situations, the "why" information provided in explainable AI may not enhance user decision-making, and further research may be needed to understand how to integrate explainable AI into real systems.

READ FULL TEXT
research
05/10/2022

A Meta-Analysis of the Utility of Explainable Artificial Intelligence in Human-AI Decision-Making

Research in artificial intelligence (AI)-assisted decision-making is exp...
research
09/07/2022

Responsibility: An Example-based Explainable AI approach via Training Process Inspection

Explainable Artificial Intelligence (XAI) methods are intended to help h...
research
09/19/2023

Using AI Uncertainty Quantification to Improve Human Decision-Making

AI Uncertainty Quantification (UQ) has the potential to improve human de...
research
01/26/2022

Cybertrust: From Explainable to Actionable and Interpretable AI (AI2)

To benefit from AI advances, users and operators of AI systems must have...
research
05/27/2020

Who is this Explanation for? Human Intelligence and Knowledge Graphs for eXplainable AI

eXplainable AI focuses on generating explanations for the output of an A...
research
06/07/2021

Explainable Artificial Intelligence (XAI) for Increasing User Trust in Deep Reinforcement Learning Driven Autonomous Systems

We consider the problem of providing users of deep Reinforcement Learnin...
research
01/13/2023

Towards Reconciling Usability and Usefulness of Explainable AI Methodologies

Interactive Artificial Intelligence (AI) agents are becoming increasingl...

Please sign up or login with your details

Forgot password? Click here to reset