Selectively Providing Reliance Calibration Cues With Reliance Prediction

02/20/2023
by   Yosuke Fukuchi, et al.
0

For effective collaboration between humans and intelligent agents that employ machine learning for decision-making, humans must understand what agents can and cannot do to avoid over/under-reliance. A solution to this problem is adjusting human reliance through communication using reliance calibration cues (RCCs) to help humans assess agents' capabilities. Previous studies typically attempted to calibrate reliance by continuously presenting RCCs, and when an agent should provide RCCs remains an open question. To answer this, we propose Pred-RC, a method for selectively providing RCCs. Pred-RC uses a cognitive reliance model to predict whether a human will assign a task to an agent. By comparing the prediction results for both cases with and without an RCC, Pred-RC evaluates the influence of the RCC on human reliance. We tested Pred-RC in a human-AI collaboration task and found that it can successfully calibrate human reliance with a reduced number of RCCs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/08/2022

Influence of anthropomorphic agent on human empathy through games

The social acceptance of AI agents, including intelligent virtual agents...
research
10/19/2020

Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration

In this paper, we introduce Watch-And-Help (WAH), a challenge for testin...
research
11/05/2021

Shared Model of Sense-making for Human-Machine Collaboration

We present a model of sense-making that greatly facilitates the collabor...
research
01/08/2022

Modeling Human-AI Team Decision Making

AI and humans bring complementary skills to group deliberations. Modelin...
research
05/07/2019

Learned human-agent decision-making, communication and joint action in a virtual reality environment

Humans make decisions and act alongside other humans to pursue both shor...
research
09/01/2021

Balancing Performance and Human Autonomy with Implicit Guidance Agent

The human-agent team, which is a problem in which humans and autonomous ...
research
06/21/2021

Cogment: Open Source Framework For Distributed Multi-actor Training, Deployment Operations

Involving humans directly for the benefit of AI agents' training is gett...

Please sign up or login with your details

Forgot password? Click here to reset