DeepAI AI Chat
Log In Sign Up

AnimePose: Multi-person 3D pose estimation and animation

by   Laxman Kumarapu, et al.
IIIT Sri City

3D animation of humans in action is quite challenging as it involves using a huge setup with several motion trackers all over the person's body to track the movements of every limb. This is time-consuming and may cause the person discomfort in wearing exoskeleton body suits with motion sensors. In this work, we present a trivial yet effective solution to generate 3D animation of multiple persons from a 2D video using deep learning. Although significant improvement has been achieved recently in 3D human pose estimation, most of the prior works work well in case of single person pose estimation and multi-person pose estimation is still a challenging problem. In this work, we firstly propose a supervised multi-person 3D pose estimation and animation framework namely AnimePose for a given input RGB video sequence. The pipeline of the proposed system consists of various modules: i) Person detection and segmentation, ii) Depth Map estimation, iii) Lifting 2D to 3D information for person localization iv) Person trajectory prediction and human pose tracking. Our proposed system produces comparable results on previous state-of-the-art 3D multi-person pose estimation methods on publicly available datasets MuCo-3DHP and MuPoTS-3D datasets and it also outperforms previous state-of-the-art human pose tracking methods by a significant margin of 11.7 score on Posetrack 2018 dataset.


page 3

page 4


Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Image

Although significant improvement has been achieved in 3D human pose esti...

Multi-Person Full Body Pose Estimation

Multi-person pose estimation plays an important role in many fields. Alt...

3D human pose estimation from depth maps using a deep combination of poses

Many real-world applications require the estimation of human body joints...

Real-time Human Pose Estimation from Video with Convolutional Neural Networks

In this paper, we present a method for real-time multi-person human pose...

Video Pose Track with Graph-Guided Sparse Motion Estimation

In this paper, we propose a novel framework for multi-person pose estima...

Person-in-WiFi: Fine-grained Person Perception using WiFi

Fine-grained person perception such as body segmentation and pose estima...