MaskBot: Real-time Robotic Projection Mapping with Head Motion Tracking

The projection mapping systems on the human face is limited by the latency and the movement of the users. The area of the projection is restricted by the position of the projectors and the cameras. We are introducing MaskBot, a real-time projection mapping system operated by a 6 Degrees of Freedom (DoF) collaborative robot. The collaborative robot locates the projector and camera in normal position to the face of the user to increase the projection area and to reduce the latency of the system. A webcam is used to detect the face and to sense the robot-user distance to modify the projection size and orientation. MaskBot projects different images on the face of the user, such as face modifications, make-up, and logos. In contrast to the existing methods, the presented system is the first that introduces a robotic projection mapping. One of the prospective applications is to acquire a dataset of adversarial images to challenge face detection DNN systems, such as Face ID.

READ FULL TEXT

page 1

page 2

research
05/09/2022

Single-Image 3D Face Reconstruction under Perspective Projection

In 3D face reconstruction, orthogonal projection has been widely employe...
research
03/20/2022

FaceOri: Tracking Head Position and Orientation Using Ultrasonic Ranging on Earphones

Face orientation can often indicate users' intended interaction target. ...
research
12/01/2021

Is Projection Mapping Natural? Towards Physical World Augmentation Consistent with Light Field Context

Projection mapping seamlessly merges real and virtual worlds. Although m...
research
10/14/2021

Talking Detection In Collaborative Learning Environments

We study the problem of detecting talking activities in collaborative le...
research
08/04/2004

Three-Dimensional Face Orientation and Gaze Detection from a Single Image

Gaze detection and head orientation are an important part of many advanc...
research
10/05/2020

Projection Mapping Implementation: Enabling Direct Externalization of Perception Results and Action Intent to Improve Robot Explainability

Existing research on non-verbal cues, e.g., eye gaze or arm movement, ma...
research
10/07/2019

CRANE: A highly dexterous needle placement robot for evaluation of interventional radiology procedures

Interventional Radiology (IR) enables earlier diagnosis and less invasiv...

Please sign up or login with your details

Forgot password? Click here to reset