Improving Facial Analysis and Performance Driven Animation through Disentangling Identity and Expression

12/27/2015
by   David Rim, et al.
0

We present techniques for improving performance driven facial animation, emotion recognition, and facial key-point or landmark prediction using learned identity invariant representations. Established approaches to these problems can work well if sufficient examples and labels for a particular identity are available and factors of variation are highly controlled. However, labeled examples of facial expressions, emotions and key-points for new individuals are difficult and costly to obtain. In this paper we improve the ability of techniques to generalize to new and unseen individuals by explicitly modeling previously seen variations related to identity and expression. We use a weakly-supervised approach in which identity labels are used to learn the different factors of variation linked to identity separately from factors related to expression. We show how probabilistic modeling of these sources of variation allows one to learn identity-invariant representations for expressions which can then be used to identity-normalize various procedures for facial expression analysis and animation control. We also show how to extend the widely used techniques of active appearance models and constrained local models through replacing the underlying point distribution models which are typically constructed using principal component analysis with identity-expression factorized representations. We present a wide variety of experiments in which we consistently improve performance on emotion recognition, markerless performance-driven facial animation and facial key-point tracking.

READ FULL TEXT

page 16

page 23

page 36

page 40

research
12/11/2018

Identity-Enhanced Network for Facial Expression Recognition

Facial expression recognition is a challenging task, arguably because of...
research
11/23/2013

Dynamic Model of Facial Expression Recognition based on Eigen-face Approach

Emotions are best way of communicating information; and sometimes it car...
research
05/12/2020

Real-time Facial Expression Recognition "In The Wild” by Disentangling 3D Expression from Identity

Human emotions analysis has been the focus of many studies, especially i...
research
09/25/2022

Optimal Transport-based Identity Matching for Identity-invariant Facial Expression Recognition

Identity-invariant facial expression recognition (FER) has been one of t...
research
11/09/2022

Interpretable Explainability in Facial Emotion Recognition and Gamification for Data Collection

Training facial emotion recognition models requires large sets of data a...
research
11/15/2018

Cybercrime and You: How Criminals Attack and the Human Factors That They Seek to Exploit

Cybercrime is a significant challenge to society, but it can be particul...
research
06/14/2020

Disentanglement for Discriminative Visual Recognition

Recent successes of deep learning-based recognition rely on maintaining ...

Please sign up or login with your details

Forgot password? Click here to reset