Smooth-Swap: A Simple Enhancement for Face-Swapping with Smoothness

12/11/2021
by   Jiseob Kim, et al.
Seoul National University
0

In recent years, face-swapping models have progressed in generation quality and drawn attention for their applications in privacy protection and entertainment. However, their complex architectures and loss functions often require careful tuning for successful training. In this paper, we propose a new face-swapping model called `Smooth-Swap', which focuses on deriving the smoothness of the identity embedding instead of employing complex handcrafted designs. We postulate that the gist of the difficulty in face-swapping is unstable gradients and it can be resolved by a smooth identity embedder. Smooth-swap adopts an embedder trained using supervised contrastive learning, where we find its improved smoothness allows faster and stable training even with a simple U-Net-based generator and three basic loss functions. Extensive experiments on face-swapping benchmarks (FFHQ, FaceForensics++) and face images in the wild show that our model is also quantitatively and qualitatively comparable or even superior to existing methods in terms of identity change.

READ FULL TEXT

page 1

page 3

page 6

page 7

page 8

page 13

page 14

page 15

05/24/2021

Face Anonymization by Manipulating Decoupled Identity Representation

Privacy protection on human biological information has drawn increasing ...
03/15/2020

Towards Privacy Protection by Generating Adversarial Identity Masks

As billions of personal data such as photos are shared through social me...
07/01/2023

DreamIdentity: Improved Editability for Efficient Face-identity Preserved Image Generation

While large-scale pre-trained text-to-image models can synthesize divers...
07/02/2023

Seeing is not Believing: An Identity Hider for Human Vision Privacy Protection

Massive captured face images are stored in the database for the identifi...
06/26/2021

ShapeEditer: a StyleGAN Encoder for Face Swapping

In this paper, we propose a novel encoder, called ShapeEditor, for high-...
02/18/2023

MorphGANFormer: Transformer-based Face Morphing and De-Morphing

Semantic face image manipulation has received increasing attention in re...

Please sign up or login with your details

Forgot password? Click here to reset