DeepAI AI Chat
Log In Sign Up

Structure-Aware 3D Hourglass Network for Hand Pose Estimation from Single Depth Image

by   Fuyang Huang, et al.

In this paper, we propose a novel structure-aware 3D hourglass network for hand pose estimation from a single depth image, which achieves state-of-the-art results on MSRA and NYU datasets. Compared to existing works that perform image-to-coordination regression, our network takes 3D voxel as input and directly regresses 3D heatmap for each joint. To be specific, we use hourglass network as our backbone network and modify it into 3D form. We explicitly model tree-like finger bone into the network as well as in the loss function in an end-to-end manner, in order to take the skeleton constraints into consideration. Final estimation can then be easily obtained from voxel density map with simple post-processing. Experimental results show that the proposed structure-aware 3D hourglass network is able to achieve a mean joint error of 7.4 mm in MSRA and 8.9 mm in NYU datasets, respectively.


page 1

page 4

page 8


FastV2C-HandNet: Fast Voxel to Coordinate Hand Pose Estimation with 3D Convolutional Neural Networks

Hand pose estimation from monocular depth images has been an important a...

End-to-end Global to Local CNN Learning for Hand Pose Recovery in Depth data

Despite recent advances in 3D pose estimation of human hands, especially...

A2J: Anchor-to-Joint Regression Network for 3D Articulated Pose Estimation from a Single Depth Image

For 3D hand and body pose estimation task in depth image, a novel anchor...

Direct Automated Quantitative Measurement of Spine via Cascade Amplifier Regression Network

Automated quantitative measurement of the spine (i.e., multiple indices ...

3D Pose Detection in Videos: Focusing on Occlusion

In this work, we build upon existing methods for occlusion-aware 3D pose...