Skeleton Driven Non-rigid Motion Tracking and 3D Reconstruction

10/09/2018
by   Shafeeq Elanattil, et al.
10

This paper presents a method which can track and 3D reconstruct the non-rigid surface motion of human performance using a moving RGB-D camera. 3D reconstruction of marker-less human performance is a challenging problem due to the large range of articulated motions and considerable non-rigid deformations. Current approaches use local optimization for tracking. These methods need many iterations to converge and may get stuck in local minima during sudden articulated movements. We propose a puppet model-based tracking approach using skeleton prior, which provides a better initialization for tracking articulated movements. The proposed approach uses an aligned puppet model to estimate correct correspondences for human performance capture. We also contribute a synthetic dataset which provides ground truth locations for frame-by-frame geometry and skeleton joints of human subjects. Experimental results show that our approach is more robust when faced with sudden articulated motions, and provides better 3D reconstruction compared to the existing state-of-the-art approaches.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

page 8

research
05/29/2018

Non-rigid Reconstruction with a Single Moving RGB-D Camera

We present a novel non-rigid reconstruction method using a moving RGB-D ...
research
03/07/2019

Synthetic Human Model Dataset for Skeleton Driven Non-rigid Motion Tracking and 3D Reconstruction

We introduce a synthetic dataset for evaluating non-rigid 3D human recon...
research
10/29/2016

FlyCap: Markerless Motion Capture Using Multiple Autonomous Flying Cameras

Aiming at automatic, convenient and non-instrusive motion capture, this ...
research
12/09/2019

DeepDeform: Learning Non-rigid RGB-D Reconstruction with Semi-supervised Data

Applying data-driven approaches to non-rigid 3D reconstruction has been ...
research
04/15/2016

Tracking Human-like Natural Motion Using Deep Recurrent Neural Networks

Kinect skeleton tracker is able to achieve considerable human body track...
research
03/07/2018

A Neural Network Approach to Missing Marker Reconstruction

Optical motion capture systems have become a widely used technology in v...

Please sign up or login with your details

Forgot password? Click here to reset