Shape Animation with Combined Captured and Simulated Dynamics

by   Benjamin Allain, et al.

We present a novel volumetric animation generation framework to create new types of animations from raw 3D surface or point cloud sequence of captured real performances. The framework considers as input time incoherent 3D observations of a moving shape, and is thus particularly suitable for the output of performance capture platforms. In our system, a suitable virtual representation of the actor is built from real captures that allows seamless combination and simulation with virtual external forces and objects, in which the original captured actor can be reshaped, disassembled or reassembled from user-specified virtual physics. Instead of using the dominant surface-based geometric representation of the capture, which is less suitable for volumetric effects, our pipeline exploits Centroidal Voronoi tessellation decompositions as unified volumetric representation of the real captured actor, which we show can be used seamlessly as a building block for all processing stages, from capture and tracking to virtual physic simulation. The representation makes no human specific assumption and can be used to capture and re-simulate the actor with props or other moving scenery elements. We demonstrate the potential of this pipeline for virtual reanimation of a real captured event with various unprecedented volumetric visual effects, such as volumetric distortion, erosion, morphing, gravity pull, or collisions.



There are no comments yet.


page 1

page 3

page 5

page 8

page 9

page 10


Going beyond Free Viewpoint: Creating Animatable Volumetric Video of Human Performances

In this paper, we present an end-to-end pipeline for the creation of hig...

Quantitative Distortion Analysis of Flattening Applied to the Scroll from En-Gedi

Non-invasive volumetric imaging can now capture the internal structure a...

General Automatic Human Shape and Motion Capture Using Volumetric Contour Cues

Markerless motion capture algorithms require a 3D body with properly per...

Model-based Outdoor Performance Capture

We propose a new model-based method to accurately reconstruct human perf...

Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensors

Human volumetric capture is a long-standing topic in computer vision and...

RealPoint3D: Point Cloud Generation from a Single Image with Complex Background

3D point cloud generation by the deep neural network from a single image...

Virtual Elastic Objects

We present Virtual Elastic Objects (VEOs): virtual objects that not only...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.