Region Based Adversarial Synthesis of Facial Action Units

10/23/2019
by   Zhilei Liu, et al.
0

Facial expression synthesis or editing has recently received increasing attention in the field of affective computing and facial expression modeling. However, most existing facial expression synthesis works are limited in paired training data, low resolution, identity information damaging, and so on. To address those limitations, this paper introduces a novel Action Unit (AU) level facial expression synthesis method called Local Attentive Conditional Generative Adversarial Network (LAC-GAN) based on face action units annotations. Given desired AU labels, LAC-GAN utilizes local AU regional rules to control the status of each AU and attentive mechanism to combine several of them into the whole photo-realistic facial expressions or arbitrary facial expressions. In addition, unpaired training data is utilized in our proposed method to train the manipulation module with the corresponding AU labels, which learns a mapping between a facial expression manifold. Extensive qualitative and quantitative evaluations are conducted on the commonly used BP4D dataset to verify the effectiveness of our proposed AU synthesis method.

READ FULL TEXT

page 9

page 10

research
12/10/2017

Geometry Guided Adversarial Facial Expression Synthesis

Facial expression synthesis has drawn much attention in the field of com...
research
02/21/2018

Conditional Adversarial Synthesis of 3D Facial Action Units

Employing deep learning-based approaches for fine-grained facial express...
research
10/23/2019

Facial Expression Restoration Based on Improved Graph Convolutional Networks

Facial expression analysis in the wild is challenging when the facial im...
research
04/07/2020

Toward Fine-grained Facial Expression Manipulation

Facial expression manipulation, as an image-to-image translation problem...
research
12/24/2021

US-GAN: On the importance of Ultimate Skip Connection for Facial Expression Synthesis

Recent studies have shown impressive results in multi-domain image-to-im...
research
07/24/2018

GANimation: Anatomically-aware Facial Animation from a Single Image

Recent advances in Generative Adversarial Networks (GANs) have shown imp...

Please sign up or login with your details

Forgot password? Click here to reset