A Quality Diversity Approach to Automatically Generating Human-Robot Interaction Scenarios in Shared Autonomy

12/08/2020
by   Matthew Fontaine, et al.
0

The growth of scale and complexity of interactions between humans and robots highlights the need for new computational methods to automatically evaluate the performance of novel algorithms and applications. Strong evaluation methods should explore the diverse scenarios of interaction between humans and robots. We propose quality diversity (QD) algorithms as a method for simultaneously exploring both environments and human actions to discover diverse failure scenarios. We focus on the shared autonomy domain, where the robot attempts to infer the goal of a human operator. We evaluate our approach by automatically generating scenarios for two published algorithms in this domain: shared autonomy via hindsight optimization and linear policy blending. Some of the generated scenarios confirm previous theoretical findings, while others are surprising and bring about a new understanding of state-of-the-art implementations. Our experiments show that QD outperforms Monte-Carlo simulation and optimization based methods in effectively searching the scenario space, highlighting its promise for automatic evaluation of algorithms in shared autonomy.

READ FULL TEXT

page 1

page 5

page 8

research
04/26/2023

Surrogate Assisted Generation of Human-Robot Interaction Scenarios

As human-robot interaction (HRI) systems advance, so does the difficulty...
research
07/17/2023

A Study in Zucker: Insights on Human-Robot Interactions

In recent years there has been a large focus on how robots can operate i...
research
09/20/2022

Exploring Human-robot Interaction by Simulating Robots

As collaborative robots enter industrial shop floors, logistics, and man...
research
03/30/2023

Human-Robot Interaction using VAHR: Virtual Assistant, Human, and Robots in the Loop

Robots have become ubiquitous tools in various industries and households...
research
04/04/2021

Perspective-corrected Spatial Referring Expression Generation for Human-Robot Interaction

Intelligent robots designed to interact with humans in real scenarios ne...
research
03/01/2023

Multiperspective Teaching of Unknown Objects via Shared-gaze-based Multimodal Human-Robot Interaction

For successful deployment of robots in multifaceted situations, an under...

Please sign up or login with your details

Forgot password? Click here to reset