Learning to Complement Humans

05/01/2020
by   Bryan Wilder, et al.
19

A rising vision for AI in the open world centers on the development of systems that can complement humans for perceptual, diagnostic, and reasoning tasks. To date, systems aimed at complementing the skills of people have employed models trained to be as accurate as possible in isolation. We demonstrate how an end-to-end learning strategy can be harnessed to optimize the combined performance of human-machine teams by considering the distinct abilities of people and machines. The goal is to focus machine learning on problem instances that are difficult for humans, while recognizing instances that are difficult for the machine and seeking human input on them. We demonstrate in two real-world domains (scientific discovery and medical diagnosis) that human-machine teams built via these methods outperform the individual performance of machines and people. We then analyze conditions under which this complementarity is strongest, and which training methods amplify it. Taken together, our work provides the first systematic investigation of how machine learning systems can be trained to complement human reasoning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/30/2020

Human vs. supervised machine learning: Who learns patterns faster?

The capabilities of supervised machine learning (SML), especially compar...
research
06/16/2022

Forming Effective Human-AI Teams: Building Machine Learning Models that Complement the Capabilities of Multiple Experts

Machine learning (ML) models are increasingly being used in application ...
research
06/29/2018

Training Humans and Machines

For many years, researchers in psychology, education, statistics, and ma...
research
03/22/2023

Are LLMs the Master of All Trades? : Exploring Domain-Agnostic Reasoning Skills of LLMs

The potential of large language models (LLMs) to reason like humans has ...
research
03/27/2018

How Developers Iterate on Machine Learning Workflows -- A Survey of the Applied Machine Learning Literature

Machine learning workflow development is anecdotally regarded to be an i...
research
01/24/2018

Evaluation of Interactive Machine Learning Systems

The evaluation of interactive machine learning systems remains a difficu...
research
10/07/2019

Open Set Medical Diagnosis

Machine-learned diagnosis models have shown promise as medical aides but...

Please sign up or login with your details

Forgot password? Click here to reset