Egocentric 6-DoF Tracking of Small Handheld Objects

04/16/2018
by   Rohit Pandey, et al.
0

Virtual and augmented reality technologies have seen significant growth in the past few years. A key component of such systems is the ability to track the pose of head mounted displays and controllers in 3D space. We tackle the problem of efficient 6-DoF tracking of a handheld controller from egocentric camera perspectives. We collected the HMD Controller dataset which consist of over 540,000 stereo image pairs labelled with the full 6-DoF pose of the handheld controller. Our proposed SSD-AF-Stereo3D model achieves a mean average error of 33.5 millimeters in 3D keypoint prediction and is used in conjunction with an IMU sensor on the controller to enable 6-DoF tracking. We also present results on approaches for model based full 6-DoF tracking. All our models operate under the strict constraints of real time mobile CPU inference.

READ FULL TEXT

page 6

page 7

page 8

page 11

research
04/23/2018

Efficient Pose Tracking from Natural Features in Standard Web Browsers

Computer Vision-based natural feature tracking is at the core of modern ...
research
06/23/2020

Instant 3D Object Tracking with Applications in Augmented Reality

Tracking object poses in 3D is a crucial building block for Augmented Re...
research
11/21/2017

Dynamic High Resolution Deformable Articulated Tracking

The last several years have seen significant progress in using depth cam...
research
01/30/2023

Online Learning Based Mobile Robot Controller Adaptation for Slip Reduction

Slip is a very common phenomena present in wheeled mobile robotic system...
research
10/04/2015

Efficient Hand Articulations Tracking using Adaptive Hand Model and Depth map

Real-time hand articulations tracking is important for many applications...
research
10/07/2020

A Novel Face-tracking Mouth Controller and its Application to Interacting with Bioacoustic Models

We describe a simple, computationally light, real-time system for tracki...
research
11/10/2014

An Improved Tracking using IMU and Vision Fusion for Mobile Augmented Reality Applications

Mobile Augmented Reality (MAR) is becoming an important cyber-physical s...

Please sign up or login with your details

Forgot password? Click here to reset