ReenactGAN: Learning to Reenact Faces via Boundary Transfer

07/29/2018
by   Wayne Wu, et al.
14

We present a novel learning-based framework for face reenactment. The proposed method, known as ReenactGAN, is capable of transferring facial movements and expressions from monocular video input of an arbitrary person to a target person. Instead of performing a direct transfer in the pixel space, which could result in structural artifacts, we first map the source face onto a boundary latent space. A transformer is subsequently used to adapt the boundary of source face to the boundary of target face. Finally, a target-specific decoder is used to generate the reenacted target face. Thanks to the effective and reliable boundary-based transfer, our method can perform photo-realistic face reenactment. In addition, ReenactGAN is appealing in that the whole reenactment process is purely feed-forward, and thus the reenactment process can run in real-time (30 FPS on one GTX 1080 GPU). Dataset and model will be publicly available at https://wywu.github.io/projects/ReenactGAN/ReenactGAN.html

READ FULL TEXT

page 2

page 5

page 6

page 7

page 8

page 11

page 14

research
05/28/2019

FaceSwapNet: Landmark Guided Many-to-Many Face Reenactment

Recent face reenactment studies have achieved remarkable success either ...
research
05/26/2018

Look at Boundary: A Boundary-Aware Face Alignment Algorithm

We present a novel boundary-aware face alignment algorithm by utilising ...
research
08/19/2019

Video synthesis of human upper body with realistic face

This paper presents a generative adversarial learning-based human upper ...
research
08/19/2019

Video synthesis of human upper body with realistic fac

This paper presents a generative adversarial learning-based human upper ...
research
06/08/2023

ReliableSwap: Boosting General Face Swapping Via Reliable Supervision

Almost all advanced face swapping approaches use reconstruction as the p...
research
09/10/2019

Swapped Face Detection using Deep Learning and Subjective Assessment

The tremendous success of deep learning for imaging applications has res...
research
05/11/2021

One Shot Face Swapping on Megapixels

Face swapping has both positive applications such as entertainment, huma...

Please sign up or login with your details

Forgot password? Click here to reset