What the HoloLens Maps Is Your Workspace: Fast Mapping and Set-up of Robot Cells via Head Mounted Displays and Augmented Reality

05/26/2020
by   David Puljiz, et al.
0

Classical methods of modelling and mapping robot work cells are time consuming, expensive and involve expert knowledge. We present a novel approach to mapping and cell setup using modern Head Mounted Displays (HMDs) that possess self-localisation and mapping capabilities. We leveraged these capabilities to create a point cloud of the environment and build an OctoMap - a voxel occupancy grid representation of the robot's workspace for path planning. Through the use of Augmented Reality (AR) interactions, the user can edit the created Octomap and add security zones. We perform comprehensive tests of the HoloLens' depth sensing capabilities and the quality of the resultant point cloud. A high-end laser scanner is used to provide the ground truth for the evaluation of the point cloud quality. The amount of false-positive and false-negative voxels in the OctoMap are also tested.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

research
12/27/2019

A 3D-Deep-Learning-based Augmented Reality Calibration Method for Robotic Environments using Depth Sensor Data

Augmented Reality and mobile robots are gaining much attention within in...
research
03/27/2021

AR Mapping: Accurate and Efficient Mapping for Augmented Reality

Augmented reality (AR) has gained increasingly attention from both resea...
research
05/14/2020

Dense-Resolution Network for Point Cloud Classification and Segmentation

Point cloud analysis is attracting attention from Artificial Intelligenc...
research
06/15/2021

Simplifying Robot Programming using Augmented Reality and End-User Development

Robots are widespread across diverse application contexts. Teaching robo...
research
03/01/2017

Augmented Reality for Depth Cues in Monocular Minimally Invasive Surgery

One of the major challenges in Minimally Invasive Surgery (MIS) such as ...
research
04/26/2021

Points2Sound: From mono to binaural audio using 3D point cloud scenes

Binaural sound that matches the visual counterpart is crucial to bring m...
research
03/28/2023

Inside-out Infrared Marker Tracking via Head Mounted Displays for Smart Robot Programming

Intuitive robot programming through use of tracked smart input devices r...

Please sign up or login with your details

Forgot password? Click here to reset