FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images

09/10/2019
by   Christian Zimmermann, et al.
16

Estimating 3D hand pose from single RGB images is a highly ambiguous problem that relies on an unbiased training dataset. In this paper, we analyze cross-dataset generalization when training on existing datasets. We find that approaches perform well on the datasets they are trained on, but do not generalize to other datasets or in-the-wild scenarios. As a consequence, we introduce the first large-scale, multi-view hand dataset that is accompanied by both 3D hand pose and shape annotations. For annotating this real-world dataset, we propose an iterative, semi-automated `human-in-the-loop' approach, which includes hand fitting optimization to infer both the 3D pose and shape for each sample. We show that methods trained on our dataset consistently perform well when tested on other datasets. Moreover, the dataset allows us to train a network that predicts the full articulated hand shape from a single RGB image. The evaluation set can serve as a benchmark for articulated hand shape estimation.

READ FULL TEXT

page 2

page 5

page 8

page 13

page 14

research
03/03/2019

3D Hand Shape and Pose Estimation from a Single RGB Image

This work addresses a novel and challenging problem of estimating the fu...
research
02/09/2019

3D Hand Shape and Pose from Images in the Wild

We present in this work the first end-to-end deep learning based method ...
research
04/04/2022

LISA: Learning Implicit Shape and Appearance of Hands

This paper proposes a do-it-all neural model of human hands, named LISA....
research
09/28/2021

3D Hand Pose and Shape Estimation from RGB Images for Improved Keypoint-Based Hand-Gesture Recognition

Estimating the 3D hand pose from a 2D image is a well-studied problem an...
research
10/02/2020

MM-Hand: 3D-Aware Multi-Modal Guided Hand Generative Network for 3D Hand Pose Synthesis

Estimating the 3D hand pose from a monocular RGB image is important but ...
research
04/18/2023

Parcel3D: Shape Reconstruction from Single RGB Images for Applications in Transportation Logistics

We focus on enabling damage and tampering detection in logistics and tac...
research
01/11/2018

Multi-view Consistency as Supervisory Signal for Learning Shape and Pose Prediction

We present a framework for learning single-view shape and pose predictio...

Please sign up or login with your details

Forgot password? Click here to reset