Toward Fine-grained Facial Expression Manipulation

04/07/2020
by   Jun Ling, et al.
1

Facial expression manipulation, as an image-to-image translation problem, aims at editing facial expression with a given condition. Previous methods edit an input image under the guidance of a discrete emotion label or absolute condition (e.g., facial action units) to possess the desired expression. However, these methods either suffer from changing condition-irrelevant regions or are inefficient to preserve image quality. In this study, we take these two objectives into consideration and propose a novel conditional GAN model. First, we replace continuous absolute condition with relative condition, specifically, relative action units. With relative action units, the generator learns to only transform regions of interest which are specified by non-zero-valued relative AUs, avoiding estimating the current AUs of input image. Second, our generator is built on U-Net architecture and strengthened by multi-scale feature fusion (MSF) mechanism for high-quality expression editing purpose. Extensive experiments on both quantitative and qualitative evaluation demonstrate the improvements of our proposed approach compared with the state-of-the-art expression editing methods.

READ FULL TEXT

page 1

page 9

page 10

page 11

page 12

research
11/30/2016

Semantic Facial Expression Editing using Autoencoded Flow

High-level manipulation of facial expressions in images --- such as chan...
research
10/23/2019

Region Based Adversarial Synthesis of Facial Action Units

Facial expression synthesis or editing has recently received increasing ...
research
07/26/2021

Perceptually Validated Precise Local Editing for Facial Action Units with StyleGAN

The ability to edit facial expressions has a wide range of applications ...
research
07/17/2020

LEED: Label-Free Expression Editing via Disentanglement

Recent studies on facial expression editing have obtained very promising...
research
03/12/2020

Cascade EF-GAN: Progressive Facial Expression Editing with Local Focuses

Recent advances in Generative Adversarial Nets (GANs) have shown remarka...
research
12/24/2021

US-GAN: On the importance of Ultimate Skip Connection for Facial Expression Synthesis

Recent studies have shown impressive results in multi-domain image-to-im...
research
09/19/2019

A High-Fidelity Open Embodied Avatar with Lip Syncing and Expression Capabilities

Embodied avatars as virtual agents have many applications and provide be...

Please sign up or login with your details

Forgot password? Click here to reset