Unconstrained Facial Expression Transfer using Style-based Generator

12/12/2019
by   Chao Yang, et al.
17

Facial expression transfer and reenactment has been an important research problem given its applications in face editing, image manipulation, and fabricated videos generation. We present a novel method for image-based facial expression transfer, leveraging the recent style-based GAN shown to be very effective for creating realistic looking images. Given two face images, our method can create plausible results that combine the appearance of one image and the expression of the other. To achieve this, we first propose an optimization procedure based on StyleGAN to infer hierarchical style vector from an image that disentangle different attributes of the face. We further introduce a linear combination scheme that fuses the style vectors of the two given images and generate a new face that combines the expression and appearance of the inputs. Our method can create high-quality synthesis with accurate facial reenactment. Unlike many existing methods, we do not rely on geometry annotations, and can be applied to unconstrained facial images of any identities without the need for retraining, making it feasible to generate large-scale expression-transferred results.

READ FULL TEXT

page 1

page 5

page 6

page 7

page 8

research
11/30/2016

Semantic Facial Expression Editing using Autoencoded Flow

High-level manipulation of facial expressions in images --- such as chan...
research
06/06/2020

The Criminality From Face Illusion

The automatic analysis of face images can generate predictions about a p...
research
12/08/2019

Face Beautification: Beyond Makeup Transfer

Facial appearance plays an important role in our social lives. Subjectiv...
research
09/14/2022

SCULPTOR: Skeleton-Consistent Face Creation Using a Learned Parametric Generator

Recent years have seen growing interest in 3D human faces modelling due ...
research
08/28/2023

ExpCLIP: Bridging Text and Facial Expressions via Semantic Alignment

The objective of stylized speech-driven facial animation is to create an...
research
11/18/2022

2CET-GAN: Pixel-Level GAN Model for Human Facial Expression Transfer

Recent studies have used GAN to transfer expressions between human faces...
research
08/19/2023

NeutrEx: A 3D Quality Component Measure on Facial Expression Neutrality

Accurate face recognition systems are increasingly important in sensitiv...

Please sign up or login with your details

Forgot password? Click here to reset