3D Hand Pose Detection in Egocentric RGB-D Images

11/29/2014
by   Grégory Rogez, et al.
0

We focus on the task of everyday hand pose estimation from egocentric viewpoints. For this task, we show that depth sensors are particularly informative for extracting near-field interactions of the camera wearer with his/her environment. Despite the recent advances in full-body pose estimation using Kinect-like sensors, reliable monocular hand pose estimation in RGB-D images is still an unsolved problem. The problem is considerably exacerbated when analyzing hands performing daily activities from a first-person viewpoint, due to severe occlusions arising from object manipulations and a limited field-of-view. Our system addresses these difficulties by exploiting strong priors over viewpoint and pose in a discriminative tracking-by-detection framework. Our priors are operationalized through a photorealistic synthetic model of egocentric scenes, which is used to generate training data for learning depth-based pose classifiers. We evaluate our approach on an annotated dataset of real egocentric object manipulation scenes and compare to both commercial and academic approaches. Our method provides state-of-the-art performance for both hand detection and pose estimation in egocentric RGB-D images.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

page 8

page 13

page 14

research
04/25/2018

Hand Pose Estimation via Latent 2.5D Heatmap Regression

Estimating the 3D pose of a hand is an essential part of human-computer ...
research
11/29/2014

Egocentric Pose Recognition in Four Lines of Code

We tackle the problem of estimating the 3D pose of an individual's upper...
research
01/24/2019

Teaching robots to imitate a human with no on-teacher sensors. What are the key challenges?

In this paper, we consider the problem of learning object manipulation t...
research
02/07/2023

3D Neural Embedding Likelihood for Robust Sim-to-Real Transfer in Inverse Graphics

A central challenge in 3D scene perception via inverse graphics is robus...
research
04/07/2017

Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor

We present an approach for real-time, robust and accurate hand pose esti...
research
04/03/2017

Capturing Hand Motion with an RGB-D Sensor, Fusing a Generative Model with Salient Points

Hand motion capture has been an active research topic in recent years, f...
research
02/04/2019

Implicit 3D Orientation Learning for 6D Object Detection from RGB Images

We propose a real-time RGB-based pipeline for object detection and 6D po...

Please sign up or login with your details

Forgot password? Click here to reset