Should I Follow AI-based Advice? Measuring Appropriate Reliance in Human-AI Decision-Making

04/14/2022
by   Max Schemmer, et al.
0

Many important decisions in daily life are made with the help of advisors, e.g., decisions about medical treatments or financial investments. Whereas in the past, advice has often been received from human experts, friends, or family, advisors based on artificial intelligence (AI) have become more and more present nowadays. Typically, the advice generated by AI is judged by a human and either deemed reliable or rejected. However, recent work has shown that AI advice is not always beneficial, as humans have shown to be unable to ignore incorrect AI advice, essentially representing an over-reliance on AI. Therefore, the aspired goal should be to enable humans not to rely on AI advice blindly but rather to distinguish its quality and act upon it to make better decisions. Specifically, that means that humans should rely on the AI in the presence of correct advice and self-rely when confronted with incorrect advice, i.e., establish appropriate reliance (AR) on AI advice on a case-by-case basis. Current research lacks a metric for AR. This prevents a rigorous evaluation of factors impacting AR and hinders further development of human-AI decision-making. Therefore, based on the literature, we derive a measurement concept of AR. We propose to view AR as a two-dimensional construct that measures the ability to discriminate advice quality and behave accordingly. In this article, we derive the measurement concept, illustrate its application and outline potential future research.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/04/2023

Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanations

AI advice is becoming increasingly popular, e.g., in investment and medi...
research
05/03/2022

On the Effect of Information Asymmetry in Human-AI Teams

Over the last years, the rising capabilities of artificial intelligence ...
research
04/27/2021

Do We Expect More from Radiology AI than from Radiologists?

What we expect from radiology AI algorithms will shape the selection and...
research
08/29/2023

From DDMs to DNNs: Using process data and models of decision-making to improve human-AI interactions

Over the past decades, cognitive neuroscientists and behavioral economis...
research
07/21/2023

Predict-AI-bility of how humans balance self-interest with the interest of others

Generative artificial intelligence holds enormous potential to revolutio...
research
11/02/2021

Instructive artificial intelligence (AI) for human training, assistance, and explainability

We propose a novel approach to explainable AI (XAI) based on the concept...
research
04/03/2022

Best-Response Bayesian Reinforcement Learning with Bayes-adaptive POMDPs for Centaurs

Centaurs are half-human, half-AI decision-makers where the AI's goal is ...

Please sign up or login with your details

Forgot password? Click here to reset