DeepAI AI Chat
Log In Sign Up

Region Based Adversarial Synthesis of Facial Action Units

by   Zhilei Liu, et al.

Facial expression synthesis or editing has recently received increasing attention in the field of affective computing and facial expression modeling. However, most existing facial expression synthesis works are limited in paired training data, low resolution, identity information damaging, and so on. To address those limitations, this paper introduces a novel Action Unit (AU) level facial expression synthesis method called Local Attentive Conditional Generative Adversarial Network (LAC-GAN) based on face action units annotations. Given desired AU labels, LAC-GAN utilizes local AU regional rules to control the status of each AU and attentive mechanism to combine several of them into the whole photo-realistic facial expressions or arbitrary facial expressions. In addition, unpaired training data is utilized in our proposed method to train the manipulation module with the corresponding AU labels, which learns a mapping between a facial expression manifold. Extensive qualitative and quantitative evaluations are conducted on the commonly used BP4D dataset to verify the effectiveness of our proposed AU synthesis method.


page 9

page 10


Geometry Guided Adversarial Facial Expression Synthesis

Facial expression synthesis has drawn much attention in the field of com...

Conditional Adversarial Synthesis of 3D Facial Action Units

Employing deep learning-based approaches for fine-grained facial express...

Facial Expression Restoration Based on Improved Graph Convolutional Networks

Facial expression analysis in the wild is challenging when the facial im...

Toward Fine-grained Facial Expression Manipulation

Facial expression manipulation, as an image-to-image translation problem...

US-GAN: On the importance of Ultimate Skip Connection for Facial Expression Synthesis

Recent studies have shown impressive results in multi-domain image-to-im...

GANimation: Anatomically-aware Facial Animation from a Single Image

Recent advances in Generative Adversarial Networks (GANs) have shown imp...