Improving Human Decision-Making with Machine Learning

08/19/2021
by   Hamsa Bastani, et al.
0

A key aspect of human intelligence is their ability to convey their knowledge to others in succinct forms. However, despite their predictive power, current machine learning models are largely blackboxes, making it difficult for humans to extract useful insights. Focusing on sequential decision-making, we design a novel machine learning algorithm that conveys its insights to humans in the form of interpretable "tips". Our algorithm selects the tip that best bridges the gap in performance between human users and the optimal policy. We evaluate our approach through a series of randomized controlled user studies where participants manage a virtual kitchen. Our experiments show that the tips generated by our algorithm can significantly improve human performance relative to intuitive baselines. In addition, we discuss a number of empirical insights that can help inform the design of algorithms intended for human-AI interfaces. For instance, we find evidence that participants do not simply blindly follow our tips; instead, they combine them with their own experience to discover additional strategies for improving performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/22/2023

Deliberating with AI: Improving Decision-Making for the Future through Participatory AI Design and Stakeholder Deliberation

Research exploring how to support decision-making has often used machine...
research
02/17/2023

Competent but Rigid: Identifying the Gap in Empowering AI to Participate Equally in Group Decision-Making

Existing research on human-AI collaborative decision-making focuses main...
research
09/27/2022

Learning When to Advise Human Decision Makers

Artificial intelligence (AI) systems are increasingly used for providing...
research
03/16/2020

Harnessing Explanations to Bridge AI and Humans

Machine learning models are increasingly integrated into societally crit...
research
03/30/2020

How human judgment impairs automated deception detection performance

Background: Deception detection is a prevalent problem for security prac...
research
09/14/2019

Towards Effective Human-AI Teams: The Case of Collaborative Packing

We focus on the problem of designing an artificial agent, capable of ass...
research
09/14/2019

Towards Effective Human-AI Teams: The Case of Human-Robot Packing

We focus on the problem of designing an artificial agent capable of assi...

Please sign up or login with your details

Forgot password? Click here to reset