Concepts for End-to-end Augmented Reality based Human-Robot Interaction Systems

10/10/2019
by   David Puljiz, et al.
0

The field of Augmented Reality (AR) based Human Robot Interaction (HRI) has progressed significantly since its inception more than two decades ago. With more advanced devices, particularly head-mounted displays (HMD), freely available programming environments and better connectivity, the possible application space expanded significantly. Here we present concepts and systems currently being developed at our lab to enable a truly end-to-end application of AR in HRI, from setting up the working environment of the robot, through programming and finally interaction with the programmed robot. Relevant papers by other authors will also be overviewed. We demonstrate the use of such technologies with systems not inherently designed to be collaborative, namely industrial manipulators. By trying to make such industrial systems easily-installable, collaborative and interactive, the vision of universal robot co-workers can be pushed one step closer to reality. The main goal of the paper is to provide a short overview of the capabilities of HMD-based HRI to researchers unfamiliar with the concepts. For researchers already using such techniques, the hope is to perhaps introduce some new ideas and to broaden the field of research.

READ FULL TEXT

page 2

page 3

page 4

research
09/06/2019

AR-based interaction for safe human-robot collaborative manufacturing

Industrial standards define safety requirements for Human-Robot Collabor...
research
04/07/2022

Updating Industrial Robots for Emerging Technologies

Industrial arms need to evolve beyond their standard shape to embrace ne...
research
04/04/2019

Referencing between a Head-Mounted Device and Robotic Manipulators

Having a precise and robust transformation between the robot coordinate ...
research
04/26/2023

Multimodal Grounding for Embodied AI via Augmented Reality Headsets for Natural Language Driven Task Planning

Recent advances in generative modeling have spurred a resurgence in the ...
research
09/10/2021

Human-Robot Interaction via a Joint-Initiative Supervised Autonomy (JISA) Framework

In this paper, we propose and validate a Joint-Initiative Supervised Aut...
research
03/28/2023

Inside-out Infrared Marker Tracking via Head Mounted Displays for Smart Robot Programming

Intuitive robot programming through use of tracked smart input devices r...
research
05/26/2021

A Concise Guide to Elicitation Methodology

One of the open questions in the field of interaction design is "what in...

Please sign up or login with your details

Forgot password? Click here to reset