Sensorless Hand Guidance using Microsoft Hololens

01/15/2019
by   David Puljiz, et al.
0

Hand guidance of robots has proven to be a useful tool both for programming trajectories and in kinesthetic teaching. However hand guidance is usually relegated to robots possessing joint-torque sensors (JTS). Here we propose to extend hand guidance to robots lacking those sensors through the use of an Augmented Reality (AR) device, namely Microsoft's Hololens. Augmented reality devices have been envisioned as a helpful addition to ease both robot programming and increase situational awareness of humans working in close proximity to robots. We reference the robot by using a registration algorithm to match a robot model to the spatial mesh. The in-built hand tracking capabilities are then used to calculate the position of the hands relative to the robot. By decomposing the hand movements into orthogonal rotations we achieve a completely sensorless hand guidance without any need to build a dynamic model of the robot itself. We did the first tests our approach on a commonly used industrial manipulator, the KUKA KR-5.

READ FULL TEXT

page 1

page 2

research
08/13/2019

General Hand Guidance Framework using Microsoft HoloLens

Hand guidance emerged from the safety requirements for collaborative rob...
research
06/15/2021

Simplifying Robot Programming using Augmented Reality and End-User Development

Robots are widespread across diverse application contexts. Teaching robo...
research
08/18/2022

Towards Situation Awareness and Attention Guidance in a Multiplayer Environment using Augmented Reality and Carcassonne

Augmented reality (AR) games are a rich environment for researching and ...
research
08/21/2023

Communicating Robot's Intentions while Assisting Users via Augmented Reality

This paper explores the challenges faced by assistive robots in effectiv...
research
12/10/2020

Adapting the Human: Leveraging Wearable Technology in HRI

Adhering to current HRI paradigms, all of the sensors, visualisation and...
research
03/28/2023

Inside-out Infrared Marker Tracking via Head Mounted Displays for Smart Robot Programming

Intuitive robot programming through use of tracked smart input devices r...
research
07/02/2022

Arigatō: Effects of Adaptive Guidance on Engagement and Performance in Augmented Reality Learning Environments

Experiential learning (ExL) is the process of learning through experienc...

Please sign up or login with your details

Forgot password? Click here to reset