DeepAI AI Chat
Log In Sign Up

Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-making

by   Charvi Rastogi, et al.

Several strands of research have aimed to bridge the gap between artificial intelligence (AI) and human decision-makers in AI-assisted decision-making, where humans are the consumers of AI model predictions and the ultimate decision-makers in high-stakes applications. However, people's perception and understanding is often distorted by their cognitive biases, like confirmation bias, anchoring bias, availability bias, to name a few. In this work, we use knowledge from the field of cognitive science to account for cognitive biases in the human-AI collaborative decision-making system and mitigate their negative effects. To this end, we mathematically model cognitive biases and provide a general framework through which researchers and practitioners can understand the interplay between cognitive biases and human-AI accuracy. We then focus on anchoring bias, a bias commonly witnessed in human-AI partnerships. We devise a cognitive science-driven, time-based approach to de-anchoring. A user experiment shows the effectiveness of this approach in human-AI collaborative decision-making. Using the results from this first experiment, we design a time allocation strategy for a resource constrained setting so as to achieve optimal human-AI collaboration under some assumptions. A second user study shows that our time allocation strategy can effectively debias the human when the AI model has low confidence and is incorrect.


page 1

page 2

page 3

page 4


BIASeD: Bringing Irrationality into Automated System Design

Human perception, memory and decision-making are impacted by tens of cog...

Left, Right, and Gender: Exploring Interaction Traces to Mitigate Human Biases

Human biases impact the way people analyze data and make decisions. Rece...

Model-agnostic Fits for Understanding Information Seeking Patterns in Humans

In decision making tasks under uncertainty, humans display characteristi...

Studying the Effects of Cognitive Biases in Evaluation of Conversational Agents

Humans quite frequently interact with conversational agents. The rapid a...

Decision Making "Biases" and Support for Assumption-Based Higher-Order Reasoning

Unaided human decision making appears to systematically violate consiste...

Reward-Based Deception with Cognitive Bias

Deception plays a key role in adversarial or strategic interactions for ...

Measuring Bias in AI Models with Application to Face Biometrics: An Statistical Approach

The new regulatory framework proposal on Artificial Intelligence (AI) pu...