Accurate Face Rig Approximation with Deep Differential Subspace Reconstruction

06/02/2020
by   Steven L. Song, et al.
0

To be suitable for film-quality animation, rigs for character deformation must fulfill a broad set of requirements. They must be able to create highly stylized deformation, allow a wide variety of controls to permit artistic freedom, and accurately reflect the design intent. Facial deformation is especially challenging due to its nonlinearity with respect to the animation controls and its additional precision requirements, which often leads to highly complex face rigs that are not generalizable to other characters. This lack of generality creates a need for approximation methods that encode the deformation in simpler structures. We propose a rig approximation method that addresses these issues by learning localized shape information in differential coordinates and, separately, a subspace for mesh reconstruction. The use of differential coordinates produces a smooth distribution of errors in the resulting deformed surface, while the learned subspace provides constraints that reduce the low frequency error in the reconstruction. Our method can reconstruct both face and body deformations with high fidelity and does not require a set of well-posed animation examples, as we demonstrate with a variety of production characters.

READ FULL TEXT

page 1

page 8

page 9

page 10

page 11

research
10/05/2021

Clustering of the Blendshape Facial Model

Digital human animation relies on high-quality 3D models of the human fa...
research
08/10/2018

DeepWrinkles: Accurate and Realistic Clothing Modeling

We present a novel method to generate accurate and realistic clothing de...
research
12/07/2019

Digital Twin: Acquiring High-Fidelity 3D Avatar from a Single Image

We present an approach to generate high fidelity 3D face avatar with a h...
research
02/18/2021

DeepMetaHandles: Learning Deformation Meta-Handles of 3D Meshes with Biharmonic Coordinates

We propose DeepMetaHandles, a 3D conditional generative model based on m...
research
03/29/2022

Pop-Out Motion: 3D-Aware Image Deformation via Learning the Shape Laplacian

We propose a framework that can deform an object in a 2D image as it exi...
research
10/21/2022

HDHumans: A Hybrid Approach for High-fidelity Digital Humans

Photo-real digital human avatars are of enormous importance in graphics,...
research
03/13/2016

Modelling Developable Ribbons Using Ruling Bending Coordinates

This paper presents a new method for modelling the dynamic behaviour of ...

Please sign up or login with your details

Forgot password? Click here to reset