DeepAI
Log In Sign Up

Learning Skeletal Articulations with Neural Blend Shapes

05/06/2021
by   Peizhuo Li, et al.
0

Animating a newly designed character using motion capture (mocap) data is a long standing problem in computer animation. A key consideration is the skeletal structure that should correspond to the available mocap data, and the shape deformation in the joint regions, which often requires a tailored, pose-specific refinement. In this work, we develop a neural technique for articulating 3D characters using enveloping with a pre-defined skeletal structure which produces high quality pose dependent deformations. Our framework learns to rig and skin characters with the same articulation structure (e.g., bipeds or quadrupeds), and builds the desired skeleton hierarchy into the network architecture. Furthermore, we propose neural blend shapes–a set of corrective pose-dependent shapes which improve the deformation quality in the joint regions in order to address the notorious artifacts resulting from standard rigging and skinning. Our system estimates neural blend shapes for input meshes with arbitrary connectivity, as well as weighting coefficients which are conditioned on the input joint rotations. Unlike recent deep learning techniques which supervise the network with ground-truth rigging and skinning parameters, our approach does not assume that the training data has a specific underlying deformation model. Instead, during training, the network observes deformed shapes and learns to infer the corresponding rig, skin and blend shapes using indirect supervision. During inference, we demonstrate that our network generalizes to unseen characters with arbitrary mesh connectivity, including unrigged characters built by 3D artists. Conforming to standard skeletal animation models enables direct plug-and-play in standard animation software, as well as game engines.

READ FULL TEXT

page 7

page 12

page 13

07/28/2022

Skeleton-free Pose Transfer for Stylized 3D Characters

We present the first method that automatically transfers poses between s...
11/26/2021

DSNet: Dynamic Skin Deformation Prediction by Recurrent Neural Network

Skin dynamics contributes to the enriched realism of human body models i...
03/29/2021

View-Dependent Formulation of 2.5D Cartoon Models

2.5D cartoon models are methods to simulate three-dimensional (3D)-like ...
04/11/2021

Velocity Skinning for Real-time Stylized Skeletal Animation

Secondary animation effects are essential for liveliness. We propose a s...
08/22/2019

Predicting Animation Skeletons for 3D Articulated Models via Volumetric Nets

We present a learning method for predicting animation skeletons for inpu...
02/09/2022

NIMBLE: A Non-rigid Hand Model with Bones and Muscles

Emerging Metaverse applications demand reliable, accurate, and photoreal...
12/12/2022

Transfer Learning using Spectral Convolutional Autoencoders on Semi-Regular Surface Meshes

The underlying dynamics and patterns of 3D surface meshes deforming over...