Inside-out Infrared Marker Tracking via Head Mounted Displays for Smart Robot Programming

03/28/2023
by   David Puljiz, et al.
0

Intuitive robot programming through use of tracked smart input devices relies on fixed, external tracking systems, most often employing infra-red markers. Such an approach is frequently combined with projector-based augmented reality for better visualisation and interface. The combined system, although providing an intuitive programming platform with short cycle times even for inexperienced users, is immobile, expensive and requires extensive calibration. When faced with a changing environment and large number of robots it becomes sorely impractical. Here we present our work on infra-red marker tracking using the Microsoft HoloLens head-mounted display. The HoloLens can map the environment, register the robot on-line, and track smart devices equipped with infra-red markers in the robot coordinate system. We envision our work to provide the basis to transfer many of the paradigms developed over the years for systems requiring a projector and a tracked input device into a highly-portable system that does not require any calibration or special set-up. We test the quality of the marker-tracking in an industrial robot cell and compare our tracking with a ground truth obtained via an ART-3 tracking system.

READ FULL TEXT

page 1

page 3

research
07/05/2021

Online and Offline Robot Programming via Augmented Reality Workspaces

Robot programming methods for industrial robots are time consuming and o...
research
04/04/2019

Referencing between a Head-Mounted Device and Robotic Manipulators

Having a precise and robust transformation between the robot coordinate ...
research
08/13/2019

General Hand Guidance Framework using Microsoft HoloLens

Hand guidance emerged from the safety requirements for collaborative rob...
research
10/10/2019

Concepts for End-to-end Augmented Reality based Human-Robot Interaction Systems

The field of Augmented Reality (AR) based Human Robot Interaction (HRI) ...
research
01/15/2019

Sensorless Hand Guidance using Microsoft Hololens

Hand guidance of robots has proven to be a useful tool both for programm...
research
05/26/2020

What the HoloLens Maps Is Your Workspace: Fast Mapping and Set-up of Robot Cells via Head Mounted Displays and Augmented Reality

Classical methods of modelling and mapping robot work cells are time con...
research
12/10/2020

Adapting the Human: Leveraging Wearable Technology in HRI

Adhering to current HRI paradigms, all of the sensors, visualisation and...

Please sign up or login with your details

Forgot password? Click here to reset