GraphPoseGAN: 3D Hand Pose Estimation from a Monocular RGB Image via Adversarial Learning on Graphs

12/04/2019
by   Yiming He, et al.
0

This paper addresses the problem of 3D hand pose estimation from a monocular RGB image. We are the first to propose a graph-based generative adversarial learning framework regularized by a hand model, aiming at realistic 3D hand pose estimation. Our model consists of a 3D hand pose generator and a multi-source discriminator. Taking one monocular RGB image as the input, the generator is essentially a residual graph convolution module with a parametric deformable hand model as prior for pose refinement. Further, we design a multi-source discriminator with hand poses, bones and the input image as input to capture intrinsic features, which distinguishes the predicted 3D hand pose from the ground-truth and leads to anthropomorphically valid hand poses. In addition, we propose two novel bone-constrained loss functions, which characterize the morphable structure of hand poses explicitly. Extensive experiments demonstrate that our model sets new state-of-the-art performances in 3D hand pose estimation from a monocular image on standard benchmarks.

READ FULL TEXT

page 1

page 8

research
03/26/2018

3D Human Pose Estimation in the Wild by Adversarial Learning

Recently, remarkable advances have been achieved in 3D human pose estima...
research
03/15/2019

Adversarial Joint Image and Pose Distribution Learning for Camera Pose Regression and Refinement

In this paper we present a deep-learning based framework for direct came...
research
11/25/2018

Generating Realistic Training Images Based on Tonality-Alignment Generative Adversarial Networks for Hand Pose Estimation

Hand pose estimation from a monocular RGB image is an important but chal...
research
08/18/2023

Denoising Diffusion for 3D Hand Pose Estimation from Images

Hand pose estimation from a single image has many applications. However,...
research
02/05/2020

Rotation-invariant Mixed Graphical Model Network for 2D Hand Pose Estimation

In this paper, we propose a new architecture named Rotation-invariant Mi...
research
12/11/2017

Using a single RGB frame for real time 3D hand pose estimation in the wild

We present a method for the real-time estimation of the full 3D pose of ...
research
09/18/2019

Adaptive Graphical Model Network for 2D Handpose Estimation

In this paper, we propose a new architecture called Adaptive Graphical M...

Please sign up or login with your details

Forgot password? Click here to reset