Investigating the Usability of Collaborative Robot control through Hands-Free Operation using Eye gaze and Augmented Reality

06/22/2023
by   Joosun Lee, et al.
0

This paper proposes a novel operation for controlling a mobile robot using a head-mounted device. Conventionally, robots are operated using computers or a joystick, which creates limitations in usability and flexibility because control equipment has to be carried by hand. This lack of flexibility may prevent workers from multitasking or carrying objects while operating the robot. To address this limitation, we propose a hands-free method to operate the mobile robot with a human gaze in an Augmented Reality (AR) environment. The proposed work is demonstrated using the HoloLens 2 to control the mobile robot, Robotnik Summit-XL, through the eye-gaze in AR. Stable speed control and navigation of the mobile robot were achieved through admittance control which was calculated using the gaze position. The experiment was conducted to compare the usability between the joystick and the proposed operation, and the results were validated through surveys (i.e., SUS, SEQ). The survey results from the participants after the experiments showed that the wearer of the HoloLens accurately operated the mobile robot in a collaborative manner. The results for both the joystick and the HoloLens were marked as easy to use with above-average usability. This suggests that the HoloLens can be used as a replacement for the joystick to allow hands-free robot operation and has the potential to increase the efficiency of human-robot collaboration in situations when hands-free controls are needed.

READ FULL TEXT

page 1

page 2

page 5

research
05/08/2023

ARDIE: AR, Dialogue, and Eye Gaze Policies for Human-Robot Collaboration

Human-robot collaboration (HRC) has become increasingly relevant in indu...
research
08/25/2022

Design and Implementation of a Human-Robot Joint Action Framework using Augmented Reality and Eye Gaze

When humans work together to complete a joint task, each person builds a...
research
08/21/2023

Impact of geolocation data on augmented reality usability: A comparative user test

Abstract. While the use of location-based augmented reality (AR) for edu...
research
03/09/2023

Enhancing Human-robot Collaboration by Exploring Intuitive Augmented Reality Design Representations

As the use of Augmented Reality (AR) to enhance interactions between hum...
research
12/27/2019

Augmented-Reality-Based Visualization of Navigation Data of Mobile Robots on the Microsoft Hololens – Possibilities and Limitations

The demand for mobile robots has rapidly increased in recent years due t...
research
07/12/2023

Assessing Augmented Reality Selection Techniques for Passengers in Moving Vehicles: A Real-World User Study

Nowadays, cars offer many possibilities to explore the world around you ...
research
10/24/2019

Depth Camera Based Particle Filter for Robotic Osteotomy Navigation

Active surgical robots lack acceptance in clinical practice, because the...

Please sign up or login with your details

Forgot password? Click here to reset