i3DMM: Deep Implicit 3D Morphable Model of Human Heads

11/28/2020
by   Tarun Yenamandra, et al.
5

We present the first deep implicit 3D morphable model (i3DMM) of full heads. Unlike earlier morphable face models it not only captures identity-specific geometry, texture, and expressions of the frontal face, but also models the entire head, including hair. We collect a new dataset consisting of 64 people with different expressions and hairstyles to train i3DMM. Our approach has the following favorable properties: (i) It is the first full head morphable model that includes hair. (ii) In contrast to mesh-based models it can be trained on merely rigidly aligned scans, without requiring difficult non-rigid registration. (iii) We design a novel architecture to decouple the shape model into an implicit reference shape and a deformation of this reference shape. With that, dense correspondences between shapes can be learned implicitly. (iv) This architecture allows us to semantically disentangle the geometry and color components, as color is learned in the reference space. Geometry is further disentangled as identity, expressions, and hairstyle, while color is disentangled as identity and hairstyle components. We show the merits of i3DMM using ablation studies, comparisons to state-of-the-art models, and applications such as semantic head editing and texture transfer. We will make our model publicly available.

READ FULL TEXT

page 1

page 7

page 8

page 13

page 14

page 16

page 17

page 18

research
12/02/2021

Neural Head Avatars from Monocular RGB Videos

We present Neural Head Avatars, a novel neural representation that expli...
research
12/14/2022

PhoMoH: Implicit Photorealistic 3D Models of Human Heads

We present PhoMoH, a neural network methodology to construct generative ...
research
10/21/2022

FIND: An Unsupervised Implicit 3D Model of Articulated Human Feet

In this paper we present a high fidelity and articulated 3D human foot m...
research
03/27/2023

OmniAvatar: Geometry-Guided Controllable 3D Head Synthesis

We present OmniAvatar, a novel geometry-guided 3D head synthesis model t...
research
11/18/2019

Towards a complete 3D morphable model of the human head

Three-dimensional Morphable Models (3DMMs) are powerful statistical tool...
research
02/26/2019

Disentangled Representation Learning for 3D Face Shape

In this paper, we present a novel strategy to design disentangled 3D fac...
research
08/13/2020

Modeling Caricature Expressions by 3D Blendshape and Dynamic Texture

The problem of deforming an artist-drawn caricature according to a given...

Please sign up or login with your details

Forgot password? Click here to reset