DeepAI AI Chat
Log In Sign Up

High-Quality Face Capture Using Anatomical Muscles

12/06/2018
by   Michael Bao, et al.
Industrial Light & Magic
Stanford University
0

Muscle-based systems have the potential to provide both anatomical accuracy and semantic interpretability as compared to blendshape models; however, a lack of expressivity and differentiability has limited their impact. Thus, we propose modifying a recently developed rather expressive muscle-based system in order to make it fully-differentiable; in fact, our proposed modifications allow this physically robust and anatomically accurate muscle model to conveniently be driven by an underlying blendshape basis. Our formulation is intuitive, natural, as well as monolithically and fully coupled such that one can differentiate the model from end to end, which makes it viable for both optimization and learning-based approaches for a variety of applications. We illustrate this with a number of examples including both shape matching of three-dimensional geometry as as well as the automatic determination of a three-dimensional facial pose from a single two-dimensional RGB image without using markers or depth information.

READ FULL TEXT

page 5

page 7

page 8

page 10

page 11

page 12

page 14

10/10/2020

Learning a model of facial shape and expression from 4D scans

The field of 3D face modeling has a large gap between high-end and low-e...
11/29/2018

Optimizable Object Reconstruction from a Single View

3D shape reconstruction from a single image is a highly ill-posed proble...
08/26/2023

Disjoint Pose and Shape for 3D Face Reconstruction

Existing methods for 3D face reconstruction from a few casually captured...
12/07/2018

Deep Energies for Estimating Three-Dimensional Facial Pose and Expression

While much progress has been made in capturing high-quality facial perfo...
04/02/2020

Learning Formation of Physically-Based Face Attributes

Based on a combined data set of 4000 high resolution facial scans, we in...
03/25/2018

Unsupervised Depth Estimation, 3D Face Rotation and Replacement

We present an unsupervised approach for learning to estimate three dimen...
11/04/2018

DeepKey: Towards End-to-End Physical Key Replication From a Single Photograph

This paper describes DeepKey, an end-to-end deep neural architecture cap...