Affective Workload Allocation for Multi-human Multi-robot Teams

03/18/2023
by   Wonse Jo, et al.
0

The interaction and collaboration between humans and multiple robots represent a novel field of research known as human multi-robot systems. Adequately designed systems within this field allow teams composed of both humans and robots to work together effectively on tasks such as monitoring, exploration, and search and rescue operations. This paper presents a deep reinforcement learning-based affective workload allocation controller specifically for multi-human multi-robot teams. The proposed controller can dynamically reallocate workloads based on the performance of the operators during collaborative missions with multi-robot systems. The operators' performances are evaluated through the scores of a self-reported questionnaire (i.e., subjective measurement) and the results of a deep learning-based cognitive workload prediction algorithm that uses physiological and behavioral data (i.e., objective measurement). To evaluate the effectiveness of the proposed controller, we use a multi-human multi-robot CCTV monitoring task as an example and carry out comprehensive real-world experiments with 32 human subjects for both quantitative measurement and qualitative analysis. Our results demonstrate the performance and effectiveness of the proposed controller and highlight the importance of incorporating both subjective and objective measurements of the operators' cognitive workload as well as seeking consent for workload transitions, to enhance the performance of multi-human multi-robot teams.

READ FULL TEXT

page 4

page 5

page 7

page 8

page 9

page 10

page 11

page 16

research
07/27/2020

Adaptive Workload Allocation for Multi-human Multi-robot Teams for Independent and Homogeneous Tasks

Multi-human multi-robot (MH-MR) systems have the ability to combine the ...
research
08/26/2021

Human operator cognitive availability aware Mixed-Initiative control

This paper presents a Cognitive Availability Aware Mixed-Initiative Cont...
research
10/25/2022

A Task Allocation Framework for Human Multi-Robot Collaborative Settings

The requirements of modern production systems together with more advance...
research
03/04/2023

Initial Task Allocation for Multi-Human Multi-Robot Teams with Attention-based Deep Reinforcement Learning

Multi-human multi-robot teams have great potential for complex and large...
research
12/02/2022

Tools and methods for Human-Autonomy Teaming: Contributions to cognitive state monitoring and system adaptation

The Human-Autonomy Teaming paradigm (HAT) has recently emerged to model ...
research
03/30/2021

Investigation of Multiple Resource Theory Design Principles on Robot Teleoperation and Workload Management

Robot interfaces often only use the visual channel. Inspired by Wickens'...
research
04/18/2022

Correlation between Unconscious Mouse Actions and Human Cognitive Workload

Unconscious behaviors are one of the indicators of the human perception ...

Please sign up or login with your details

Forgot password? Click here to reset