Cascaded deep monocular 3D human pose estimation with evolutionary training data

06/14/2020
by   Shichao Li, et al.
0

End-to-end deep representation learning has achieved remarkable accuracy for monocular 3D human pose estimation, yet these models may fail for unseen poses with limited and fixed training data. This paper proposes a novel data augmentation method that: (1) is scalable for synthesizing massive amount of training data (over 8 million valid 3D human poses with corresponding 2D projections) for training 2D-to-3D networks, (2) can effectively reduce dataset bias. Our method evolves a limited dataset to synthesize unseen 3D human skeletons based on a hierarchical human representation and heuristics inspired by prior knowledge. Extensive experiments show that our approach not only achieves state-of-the-art accuracy on the largest public benchmark, but also generalizes significantly better to unseen and rare poses. Relevant files and tools are available at the project website.

READ FULL TEXT

page 2

page 3

page 5

page 9

page 10

page 11

page 12

page 13

research
07/07/2022

PoseGU: 3D Human Pose Estimation with Novel Human Pose Generator and Unbiased Learning

3D pose estimation has recently gained substantial interests in computer...
research
12/14/2021

ElePose: Unsupervised 3D Human Pose Estimation by Predicting Camera Elevation and Learning Normalizing Flows on 2D Poses

Human pose estimation from single images is a challenging problem that i...
research
07/13/2023

Improving 2D Human Pose Estimation across Unseen Camera Views with Synthetic Data

Human Pose Estimation is a thoroughly researched problem; however, most ...
research
08/16/2022

PoseTrans: A Simple Yet Effective Pose Transformation Augmentation for Human Pose Estimation

Human pose estimation aims to accurately estimate a wide variety of huma...
research
01/08/2023

CameraPose: Weakly-Supervised Monocular 3D Human Pose Estimation by Leveraging In-the-wild 2D Annotations

To improve the generalization of 3D human pose estimators, many existing...
research
07/18/2020

SRNet: Improving Generalization in 3D Human Pose Estimation with a Split-and-Recombine Approach

Human poses that are rare or unseen in a training set are challenging fo...
research
12/29/2020

Chasing the Tail in Monocular 3D Human Reconstruction with Prototype Memory

Deep neural networks have achieved great progress in single-image 3D hum...

Please sign up or login with your details

Forgot password? Click here to reset