Disentangled Representation Learning for 3D Face Shape

02/26/2019
by   Zi-Hang Jiang, et al.
12

In this paper, we present a novel strategy to design disentangled 3D face shape representation. Specifically, a given 3D face shape is decomposed into identity part and expression part, which are both encoded and decoded in a nonlinear way. To solve this problem, we propose an attribute decomposition framework for 3D face mesh. To better represent face shapes which are usually nonlinear deformed between each other, the face shapes are represented by a vertex based deformation representation rather than Euclidean coordinates. The experimental results demonstrate that our method has better performance than existing methods on decomposing the identity and expression parts. Moreover, more natural expression transfer results can be achieved with our method than existing methods.

READ FULL TEXT

page 2

page 4

page 7

page 8

page 12

page 13

page 14

research
05/06/2019

FaceShapeGene: A Disentangled Shape Representation for Flexible Face Image Editing

Existing methods for face image manipulation generally focus on editing ...
research
03/24/2022

Learning Disentangled Representation for One-shot Progressive Face Swapping

Although face swapping has attracted much attention in recent years, it ...
research
04/10/2018

Exploring Disentangled Feature Representation Beyond Face Identification

This paper proposes learning disentangled but complementary face feature...
research
04/08/2021

Reconstructing Recognizable 3D Face Shapes based on 3D Morphable Models

Many recent works have reconstructed distinctive 3D face shapes by aggre...
research
07/03/2022

Are 3D Face Shapes Expressive Enough for Recognising Continuous Emotions and Action Unit Intensities?

Recognising continuous emotions and action unit (AU) intensities from fa...
research
03/28/2022

ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representations

Precise representations of 3D faces are beneficial to various computer v...
research
11/28/2020

i3DMM: Deep Implicit 3D Morphable Model of Human Heads

We present the first deep implicit 3D morphable model (i3DMM) of full he...

Please sign up or login with your details

Forgot password? Click here to reset