One Shot Face Swapping on Megapixels

05/11/2021
by   Yuhao Zhu, et al.
10

Face swapping has both positive applications such as entertainment, human-computer interaction, etc., and negative applications such as DeepFake threats to politics, economics, etc. Nevertheless, it is necessary to understand the scheme of advanced methods for high-quality face swapping and generate enough and representative face swapping images to train DeepFake detection algorithms. This paper proposes the first Megapixel level method for one shot Face Swapping (or MegaFS for short). Firstly, MegaFS organizes face representation hierarchically by the proposed Hierarchical Representation Face Encoder (HieRFE) in an extended latent space to maintain more facial details, rather than compressed representation in previous face swapping methods. Secondly, a carefully designed Face Transfer Module (FTM) is proposed to transfer the identity from a source image to the target by a non-linear trajectory without explicit feature disentanglement. Finally, the swapped faces can be synthesized by StyleGAN2 with the benefits of its training stability and powerful generative capability. Each part of MegaFS can be trained separately so the requirement of our model for GPU memory can be satisfied for megapixel face swapping. In summary, complete face representation, stable training, and limited memory usage are the three novel contributions to the success of our method. Extensive experiments demonstrate the superiority of MegaFS and the first megapixel level face swapping database is released for research on DeepFake detection and face image editing in the public domain. The dataset is at this link.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

page 8

05/13/2020

FaR-GAN for One-Shot Face Reenactment

Animating a static face image with target facial expressions and movemen...
08/31/2021

One-shot domain adaptation for semantic face editing of real world images using StyleALAE

Semantic face editing of real world facial images is an important applic...
06/26/2021

ShapeEditer: a StyleGAN Encoder for Face Swapping

In this paper, we propose a novel encoder, called ShapeEditor, for high-...
08/05/2019

One-shot Face Reenactment

To enable realistic shape (e.g. pose and expression) transfer, existing ...
02/24/2022

Controlling Memorability of Face Images

Everyday, we are bombarded with many photographs of faces, whether on so...
02/26/2020

Controllable Descendant Face Synthesis

Kinship face synthesis is an interesting topic raised to answer question...
07/29/2018

ReenactGAN: Learning to Reenact Faces via Boundary Transfer

We present a novel learning-based framework for face reenactment. The pr...

Code Repositories

One-Shot-Face-Swapping-on-Megapixels

One Shot Face Swapping on Megapixels.


view repo