Learning to Fuse 2D and 3D Image Cues for Monocular Body Pose Estimation

11/17/2016
by   Bugra Tekin, et al.
0

Most recent approaches to monocular 3D human pose estimation rely on Deep Learning. They typically involve regressing from an image to either 3D joint coordinates directly or 2D joint locations from which 3D coordinates are inferred. Both approaches have their strengths and weaknesses and we therefore propose a novel architecture designed to deliver the best of both worlds by performing both simultaneously and fusing the information along the way. At the heart of our framework is a trainable fusion scheme that learns how to fuse the information optimally instead of being hand-designed. This yields significant improvements upon the state-of-the-art on standard 3D human pose estimation benchmarks.

READ FULL TEXT

page 8

page 9

page 10

page 11

research
06/02/2020

Monocular Human Pose Estimation: A Survey of Deep Learning-based Methods

Vision-based monocular human pose estimation, as one of the most fundame...
research
11/30/2015

Sparseness Meets Deepness: 3D Human Pose Estimation from Monocular Video

This paper addresses the challenge of 3D full-body human pose estimation...
research
06/11/2014

Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation

This paper proposes a new hybrid architecture that consists of a deep Co...
research
09/18/2017

Direct Pose Estimation with a Monocular Camera

We present a direct method to calculate a 6DoF pose change of a monocula...
research
11/03/2021

Improving Pose Estimation through Contextual Activity Fusion

This research presents the idea of activity fusion into existing Pose Es...
research
12/14/2015

Understanding Human-Centric Images: From Geometry to Fashion

Understanding humans from photographs has always been a fundamental goal...
research
04/19/2014

Unified Structured Learning for Simultaneous Human Pose Estimation and Garment Attribute Classification

In this paper, we utilize structured learning to simultaneously address ...

Please sign up or login with your details

Forgot password? Click here to reset