Enhancing autonomy transparency: an option-centric rationale approach

08/03/2020
by   Ruikun Luo, et al.
0

While the advances in artificial intelligence and machine learning empower a new generation of autonomous systems for assisting human performance, one major concern arises from the human factors perspective: Humans have difficulty deciphering autonomy-generated solutions and increasingly perceive autonomy as a mysterious black box. The lack of transparency contributes to the lack of trust in autonomy and sub-optimal team performance. To enhance autonomy transparency, this study proposed an option-centric rationale display and evaluated its effectiveness. We developed a game Treasure Hunter wherein a human uncovers a map for treasures with the help from an intelligent assistant, and conducted a human-in-the-loop experiment with 34 participants. Results indicated that by conveying the intelligent assistant's decision-making rationale via the option-centric rationale display, participants had higher trust in the system and calibrated their trust faster. Additionally, higher trust led to higher acceptance of recommendations from the intelligent assistant, and in turn higher task performance.

READ FULL TEXT
research
06/29/2020

Human Trust-based Feedback Control: Dynamically varying automation transparency to optimize human-machine interactions

Human trust in automation plays an essential role in interactions betwee...
research
12/27/2022

Measuring an artificial intelligence agent's trust in humans using machine incentives

Scientists and philosophers have debated whether humans can trust advanc...
research
05/31/2023

Human-centric Literature on Trust for SfTI Veracity Spearhead

This article summarizes the literature on trust of digital technologies ...
research
11/17/2020

Towards evaluating and eliciting high-quality documentation for intelligent systems

A vital component of trust and transparency in intelligent systems built...
research
08/03/2017

A glass-box interactive machine learning approach for solving NP-hard problems with the human-in-the-loop

The goal of Machine Learning to automatically learn from data, extract k...
research
10/24/2019

Interactive Image Restoration

Machine learning and many of its applications are considered hard to app...
research
07/07/2021

Towards Achieving Trust Through Transparency and Ethics (Pre-Print)

The ubiquitous presence of software in the products we use, together wit...

Please sign up or login with your details

Forgot password? Click here to reset