"Dave...I can assure you...that it's going to be all right..." -- A definition, case for, and survey of algorithmic assurances in human-autonomy trust relationships

11/08/2017
by   Brett W Israelsen, et al.
0

As technology becomes more advanced, those who design, use and are otherwise affected by it want to know that it will perform correctly, and understand why it does what it does, and how to use it appropriately. In essence they want to be able to trust the systems that are being designed. In this survey we present assurances that are the method by which users can understand how to trust autonomous systems. Trust between humans and autonomy is reviewed, and the implications for the design of assurances are highlighted. A survey of existing research related to assurances is presented. Much of the surveyed research originates from fields such as interpretable, comprehensible, transparent, and explainable machine learning, as well as human-computer interaction, human-robot interaction, and e-commerce. Several key ideas are extracted from this work in order to refine the definition of assurances. The design of assurances is found to be highly dependent not only on the capabilities of the autonomous system, but on the characteristics of the human user, and the appropriate trust-related behaviors. Several directions for future research are identified and discussed.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/09/2022

The Roles and Modes of Human Interactions with Automated Machine Learning Systems

As automated machine learning (AutoML) systems continue to progress in b...
research
06/30/2022

Evaluation of Performance-Trust vs Moral-Trust Violation in 3D Environment

Human-Robot Interaction, in which a robot with some level of autonomy in...
research
05/06/2021

Explainable Autonomous Robots: A Survey and Perspective

Advanced communication protocols are critical to enable the coexistence ...
research
05/06/2022

Tell Me Something That Will Help Me Trust You: A Survey of Trust Calibration in Human-Agent Interaction

When a human receives a prediction or recommended course of action from ...
research
03/24/2023

Converging Measures and an Emergent Model: A Meta-Analysis of Human-Automation Trust Questionnaires

A significant challenge to measuring human-automation trust is the amoun...
research
03/27/2018

A Classification Model for Sensing Human Trust in Machines Using EEG and GSR

Today, intelligent machines interact and collaborate with humans in a wa...

Please sign up or login with your details

Forgot password? Click here to reset