Generalized Feedback Loop for Joint Hand-Object Pose Estimation

03/25/2019
by   Markus Oberweger, et al.
6

We propose an approach to estimating the 3D pose of a hand, possibly handling an object, given a depth image. We show that we can correct the mistakes made by a Convolutional Neural Network trained to predict an estimate of the 3D pose by using a feedback loop. The components of this feedback loop are also Deep Networks, optimized using training data. This approach can be generalized to a hand interacting with an object. Therefore, we jointly estimate the 3D pose of the hand and the 3D pose of the object. Our approach performs en-par with state-of-the-art methods for 3D hand pose estimation, and outperforms state-of-the-art methods for joint hand-object pose estimation when using depth images only. Also, our approach is efficient as our implementation runs in real-time on a single GPU.

READ FULL TEXT

page 4

page 12

page 13

page 15

research
09/30/2016

Training a Feedback Loop for Hand Pose Estimation

We propose an entirely data-driven approach to estimating the 3D pose of...
research
07/15/2019

FastV2C-HandNet: Fast Voxel to Coordinate Hand Pose Estimation with 3D Convolutional Neural Networks

Hand pose estimation from monocular depth images has been an important a...
research
03/18/2022

Perspective Flow Aggregation for Data-Limited 6D Object Pose Estimation

Most recent 6D object pose estimation methods, including unsupervised on...
research
11/11/2021

Dynamic Iterative Refinement for Efficient 3D Hand Pose Estimation

While hand pose estimation is a critical component of most interactive e...
research
12/11/2017

3D Hand Pose Estimation: From Current Achievements to Future Goals

In this paper, we strive to answer two questions: What is the current st...
research
03/31/2020

HOPE-Net: A Graph-based Model for Hand-Object Pose Estimation

Hand-object pose estimation (HOPE) aims to jointly detect the poses of b...
research
09/11/2023

ViHOPE: Visuotactile In-Hand Object 6D Pose Estimation with Shape Completion

In this letter, we introduce ViHOPE, a novel framework for estimating th...

Please sign up or login with your details

Forgot password? Click here to reset