Assessing Human Interaction in Virtual Reality With Continually Learning Prediction Agents Based on Reinforcement Learning Algorithms: A Pilot Study

12/14/2021
by   Dylan J. A. Brenneis, et al.
0

Artificial intelligence systems increasingly involve continual learning to enable flexibility in general situations that are not encountered during system training. Human interaction with autonomous systems is broadly studied, but research has hitherto under-explored interactions that occur while the system is actively learning, and can noticeably change its behaviour in minutes. In this pilot study, we investigate how the interaction between a human and a continually learning prediction agent develops as the agent develops competency. Additionally, we compare two different agent architectures to assess how representational choices in agent design affect the human-agent interaction. We develop a virtual reality environment and a time-based prediction task wherein learned predictions from a reinforcement learning (RL) algorithm augment human predictions. We assess how a participant's performance and behaviour in this task differs across agent types, using both quantitative and qualitative analyses. Our findings suggest that human trust of the system may be influenced by early interactions with the agent, and that trust in turn affects strategic behaviour, but limitations of the pilot study rule out any conclusive statement. We identify trust as a key feature of interaction to focus on when considering RL-based technologies, and make several recommendations for modification to this study in preparation for a larger-scale investigation. A video summary of this paper can be found at https://youtu.be/oVYJdnBqTwQ .

READ FULL TEXT
research
01/11/2022

Pavlovian Signalling with General Value Functions in Agent-Agent Temporal Decision Making

In this paper, we contribute a multi-faceted study into Pavlovian signal...
research
09/14/2020

Effective Favor Exchange for Human-Agent Negotiation Challenge at IJCAI 2020

This document describes Pilot, our submission for Human-Agent Negotiatio...
research
05/05/2022

Metaversal Learning Environments: Measuring, predicting and improving interpersonal effectiveness

Experiential learning has been known to be an engaging and effective mod...
research
03/17/2022

The Frost Hollow Experiments: Pavlovian Signalling as a Path to Coordination and Communication Between Agents

Learned communication between agents is a powerful tool when approaching...
research
10/13/2022

Adapting Behaviour Based On Trust In Human-Agent Ad Hoc Teamwork

This work proposes a framework that incorporates trust in an ad hoc team...
research
04/16/2019

Learning 3D Navigation Protocols on Touch Interfaces with Cooperative Multi-Agent Reinforcement Learning

Using touch devices to navigate in virtual 3D environments such as compu...
research
01/01/2021

The Challenges in Modeling Human Performance in 3D Space with Fitts' Law

With the rapid growth in virtual reality technologies, object interactio...

Please sign up or login with your details

Forgot password? Click here to reset