Efficient Hand Articulations Tracking using Adaptive Hand Model and Depth map

10/04/2015
by   Byeongkeun Kang, et al.
0

Real-time hand articulations tracking is important for many applications such as interacting with virtual / augmented reality devices or tablets. However, most of existing algorithms highly rely on expensive and high power-consuming GPUs to achieve real-time processing. Consequently, these systems are inappropriate for mobile and wearable devices. In this paper, we propose an efficient hand tracking system which does not require high performance GPUs. In our system, we track hand articulations by minimizing discrepancy between depth map from sensor and computer-generated hand model. We also initialize hand pose at each frame using finger detection and classification. Our contributions are: (a) propose adaptive hand model to consider different hand shapes of users without generating personalized hand model; (b) improve the highly efficient frame initialization for robust tracking and automatic initialization; (c) propose hierarchical random sampling of pixels from each depth map to improve tracking accuracy while limiting required computations. To the best of our knowledge, it is the first system that achieves both automatic hand model adjustment and real-time tracking without using GPUs.

READ FULL TEXT

page 4

page 8

research
06/23/2020

Instant 3D Object Tracking with Applications in Augmented Reality

Tracking object poses in 3D is a crucial building block for Augmented Re...
research
10/16/2016

Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Input

Real-time simultaneous tracking of hands manipulating and interacting wi...
research
06/18/2020

MediaPipe Hands: On-device Real-time Hand Tracking

We present a real-time on-device hand tracking pipeline that predicts ha...
research
04/23/2018

Efficient Pose Tracking from Natural Features in Standard Web Browsers

Computer Vision-based natural feature tracking is at the core of modern ...
research
09/06/2014

Depth image hand tracking from an overhead perspective using partially labeled, unbalanced data: Development and real-world testing

We present the development and evaluation of a hand tracking algorithm b...
research
03/08/2016

Hand Segmentation for Hand-Object Interaction from Depth map

Hand-object interaction is important for many applications such as augme...
research
04/16/2018

Egocentric 6-DoF Tracking of Small Handheld Objects

Virtual and augmented reality technologies have seen significant growth ...

Please sign up or login with your details

Forgot password? Click here to reset