FaceSwapNet: Landmark Guided Many-to-Many Face Reenactment

05/28/2019
by   Jiangning Zhang, et al.
0

Recent face reenactment studies have achieved remarkable success either between two identities or in the many-to-one task. However, existing methods have limited scalability when the target person is not a predefined specific identity. To address this limitation, we present a novel many-to-many face reenactment framework, named FaceSwapNet, which allows transferring facial expressions and movements from one source face to arbitrary targets. Our proposed approach is composed of two main modules: the landmark swapper and the landmark-guided generator. Instead of maintaining independent models for each pair of person, the former module uses two encoders and one decoder to adapt anyone's face landmark to target persons. Using the neutral expression of the target person as a reference image, the latter module leverages geometry information from the swapped landmark to generate photo-realistic and emotion-alike images. In addition, a novel triplet perceptual loss is proposed to force the generator to learn geometry and appearance information simultaneously. We evaluate our model on RaFD dataset and the results demonstrate the superior quality of reenacted images as well as the flexibility of transferring facial movements between identities.

READ FULL TEXT

page 2

page 3

page 6

page 7

page 8

research
03/29/2020

Realistic Face Reenactment via Self-Supervised Disentangling of Identity and Pose

Recent works have shown how realistic talking face images can be obtaine...
research
07/29/2018

ReenactGAN: Learning to Reenact Faces via Boundary Transfer

We present a novel learning-based framework for face reenactment. The pr...
research
04/30/2020

APB2Face: Audio-guided face reenactment with auxiliary pose and blink signals

Audio-guided face reenactment aims at generating photorealistic faces us...
research
04/07/2021

LI-Net: Large-Pose Identity-Preserving Face Reenactment Network

Face reenactment is a challenging task, as it is difficult to maintain a...
research
03/30/2020

ActGAN: Flexible and Efficient One-shot Face Reenactment

This paper introduces ActGAN - a novel end-to-end generative adversarial...
research
11/19/2019

MarioNETte: Few-shot Face Reenactment Preserving Identity of Unseen Targets

When there is a mismatch between the target identity and the driver iden...
research
02/06/2018

Every Smile is Unique: Landmark-Guided Diverse Smile Generation

Each smile is unique: one person surely smiles in different ways (e.g., ...

Please sign up or login with your details

Forgot password? Click here to reset