Projection Mapping Implementation: Enabling Direct Externalization of Perception Results and Action Intent to Improve Robot Explainability

10/05/2020
by   Zhao Han, et al.
0

Existing research on non-verbal cues, e.g., eye gaze or arm movement, may not accurately present a robot's internal states such as perception results and action intent. Projecting the states directly onto a robot's operating environment has the advantages of being direct, accurate, and more salient, eliminating mental inference about the robot's intention. However, there is a lack of tools for projection mapping in robotics, compared to established motion planning libraries (e.g., MoveIt). In this paper, we detail the implementation of projection mapping to enable researchers and practitioners to push the boundaries for better interaction between robots and humans. We also provide practical documentation and code for a sample manipulation projection mapping on GitHub: https://github.com/uml-robotics/projection_mapping.

READ FULL TEXT

page 1

page 3

page 4

research
08/11/2017

Communicating Robot Arm Motion Intent Through Mixed Reality Head-mounted Displays

Efficient motion intent communication is necessary for safe and collabor...
research
08/25/2022

Design and Implementation of a Human-Robot Joint Action Framework using Augmented Reality and Eye Gaze

When humans work together to complete a joint task, each person builds a...
research
06/30/2023

The Bridge between Xsens Motion-Capture and Robot Operating System (ROS): Enabling Robots with Online 3D Human Motion Tracking

This document introduces the bridge between the leading inertial motion-...
research
01/08/2021

Grasp and Motion Planning for Dexterous Manipulation for the Real Robot Challenge

This report describes our winning submission to the Real Robot Challenge...
research
04/10/2009

Intent expression using eye robot for mascot robot system

An intent expression system using eye robots is proposed for a mascot ro...
research
12/09/2021

Projecting Robot Navigation Paths: Hardware and Software for Projected AR

For mobile robots, mobile manipulators, and autonomous vehicles to safel...
research
11/07/2020

MaskBot: Real-time Robotic Projection Mapping with Head Motion Tracking

The projection mapping systems on the human face is limited by the laten...

Please sign up or login with your details

Forgot password? Click here to reset