DeepAI AI Chat
Log In Sign Up

Model-based Outdoor Performance Capture

by   Nadia Robertini, et al.

We propose a new model-based method to accurately reconstruct human performances captured outdoors in a multi-camera setup. Starting from a template of the actor model, we introduce a new unified implicit representation for both, articulated skeleton tracking and nonrigid surface shape refinement. Our method fits the template to unsegmented video frames in two stages - first, the coarse skeletal pose is estimated, and subsequently non-rigid surface shape and body pose are jointly refined. Particularly for surface shape refinement we propose a new combination of 3D Gaussians designed to align the projected model with likely silhouette contours without explicit segmentation or edge detection. We obtain reconstructions of much higher quality in outdoor settings than existing methods, and show that we are on par with state-of-the-art methods on indoor scenes for which they were designed


page 1

page 3

page 5

page 6

page 7

page 8


General Automatic Human Shape and Motion Capture Using Volumetric Contour Cues

Markerless motion capture algorithms require a 3D body with properly per...

DoubleFusion: Real-time Capture of Human Performances with Inner Body Shapes from a Single Depth Sensor

We propose DoubleFusion, a new real-time system that combines volumetric...

hSMAL: Detailed Horse Shape and Pose Reconstruction for Motion Pattern Recognition

In this paper we present our preliminary work on model-based behavioral ...

Efficient Multi-view Performance Capture of Fine-Scale Surface Detail

We present a new effective way for performance capture of deforming mesh...

Dynamic Surface Function Networks for Clothed Human Bodies

We present a novel method for temporal coherent reconstruction and track...

Shape Animation with Combined Captured and Simulated Dynamics

We present a novel volumetric animation generation framework to create n...

SparseFusion: Dynamic Human Avatar Modeling from Sparse RGBD Images

In this paper, we propose a novel approach to reconstruct 3D human body ...