Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-making

10/15/2020
by   Charvi Rastogi, et al.
0

Several strands of research have aimed to bridge the gap between artificial intelligence (AI) and human decision-makers in AI-assisted decision-making, where humans are the consumers of AI model predictions and the ultimate decision-makers in high-stakes applications. However, people's perception and understanding is often distorted by their cognitive biases, like confirmation bias, anchoring bias, availability bias, to name a few. In this work, we use knowledge from the field of cognitive science to account for cognitive biases in the human-AI collaborative decision-making system and mitigate their negative effects. To this end, we mathematically model cognitive biases and provide a general framework through which researchers and practitioners can understand the interplay between cognitive biases and human-AI accuracy. We then focus on anchoring bias, a bias commonly witnessed in human-AI partnerships. We devise a cognitive science-driven, time-based approach to de-anchoring. A user experiment shows the effectiveness of this approach in human-AI collaborative decision-making. Using the results from this first experiment, we design a time allocation strategy for a resource constrained setting so as to achieve optimal human-AI collaboration under some assumptions. A second user study shows that our time allocation strategy can effectively debias the human when the AI model has low confidence and is incorrect.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/01/2022

BIASeD: Bringing Irrationality into Automated System Design

Human perception, memory and decision-making are impacted by tens of cog...
research
08/07/2021

Left, Right, and Gender: Exploring Interaction Traces to Mitigate Human Biases

Human biases impact the way people analyze data and make decisions. Rece...
research
12/09/2020

Model-agnostic Fits for Understanding Information Seeking Patterns in Humans

In decision making tasks under uncertainty, humans display characteristi...
research
02/18/2020

Studying the Effects of Cognitive Biases in Evaluation of Conversational Agents

Humans quite frequently interact with conversational agents. The rapid a...
research
03/27/2013

Decision Making "Biases" and Support for Assumption-Based Higher-Order Reasoning

Unaided human decision making appears to systematically violate consiste...
research
04/25/2019

Reward-Based Deception with Cognitive Bias

Deception plays a key role in adversarial or strategic interactions for ...
research
04/26/2023

Measuring Bias in AI Models with Application to Face Biometrics: An Statistical Approach

The new regulatory framework proposal on Artificial Intelligence (AI) pu...

Please sign up or login with your details

Forgot password? Click here to reset