Self-Supervised 3D Human Pose Estimation with Multiple-View Geometry

08/17/2021
by   Arij Bouazizi, et al.
9

We present a self-supervised learning algorithm for 3D human pose estimation of a single person based on a multiple-view camera system and 2D body pose estimates for each view. To train our model, represented by a deep neural network, we propose a four-loss function learning algorithm, which does not require any 2D or 3D body pose ground-truth. The proposed loss functions make use of the multiple-view geometry to reconstruct 3D body pose estimates and impose body pose constraints across the camera views. Our approach utilizes all available camera views during training, while the inference is single-view. In our evaluations, we show promising performance on Human3.6M and HumanEva benchmarks, while we also present a generalization study on MPI-INF-3DHP dataset, as well as several ablation results. Overall, we outperform all self-supervised learning methods and reach comparable results to supervised and weakly-supervised learning approaches. Our code and models are publicly available

READ FULL TEXT

page 4

page 6

research
03/06/2019

Self-Supervised Learning of 3D Human Pose using Multi-view Geometry

Training accurate 3D human pose estimators requires large amount of 3D g...
research
10/14/2021

Learning Temporal 3D Human Pose Estimation with Pseudo-Labels

We present a simple, yet effective, approach for self-supervised 3D huma...
research
03/23/2020

Weakly Supervised 3D Human Pose and Shape Reconstruction with Normalizing Flows

Monocular 3D human pose and shape estimation is challenging due to the m...
research
02/11/2021

A-NeRF: Surface-free Human 3D Pose Refinement via Neural Rendering

While deep learning has reshaped the classical motion capture pipeline, ...
research
01/06/2022

Enhancing Egocentric 3D Pose Estimation with Third Person Views

In this paper, we propose a novel approach to enhance the 3D body pose e...
research
11/30/2021

In-Bed Human Pose Estimation from Unseen and Privacy-Preserving Image Domains

Medical applications have benefited from the rapid advancement in comput...
research
07/29/2020

Unselfie: Translating Selfies to Neutral-pose Portraits in the Wild

Due to the ubiquity of smartphones, it is popular to take photos of one'...

Please sign up or login with your details

Forgot password? Click here to reset