A Latent Transformer for Disentangled and Identity-Preserving Face Editing

06/22/2021
by   Xu Yao, et al.
0

High quality facial image editing is a challenging problem in the movie post-production industry, requiring a high degree of control and identity preservation. Previous works that attempt to tackle this problem may suffer from the entanglement of facial attributes and the loss of the person's identity. Furthermore, many algorithms are limited to a certain task. To tackle these limitations, we propose to edit facial attributes via the latent space of a StyleGAN generator, by training a dedicated latent transformation network and incorporating explicit disentanglement and identity preservation terms in the loss function. We further introduce a pipeline to generalize our face editing to videos. Our model achieves a disentangled, controllable, and identity-preserving facial attribute editing, even in the challenging case of real (i.e., non-synthetic) images and videos. We conduct extensive experiments on image and video datasets and show that our model outperforms other state-of-the-art methods in visual quality and quantitative evaluation.

READ FULL TEXT

page 1

page 4

page 6

page 8

page 12

page 13

page 14

page 15

research
02/01/2021

Enjoy Your Editing: Controllable GANs for Image Editing via Latent Space Navigation

Controllable semantic image editing enables a user to change entire imag...
research
07/16/2023

Reinforced Disentanglement for Face Swapping without Skip Connection

The SOTA face swap models still suffer the problem of either target iden...
research
10/16/2021

Intelligent Video Editing: Incorporating Modern Talking Face Generation Algorithms in a Video Editor

This paper proposes a video editor based on OpenShot with several state-...
research
03/31/2022

TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial Editing

Recent advances like StyleGAN have promoted the growth of controllable f...
research
06/08/2023

IFaceUV: Intuitive Motion Facial Image Generation by Identity Preservation via UV map

Reenacting facial images is an important task that can find numerous app...
research
07/15/2023

Adaptive Nonlinear Latent Transformation for Conditional Face Editing

Recent works for face editing usually manipulate the latent space of Sty...
research
03/25/2017

Sketch-based Face Editing in Video Using Identity Deformation Transfer

We address the problem of using hand-drawn sketch to edit facial identit...

Please sign up or login with your details

Forgot password? Click here to reset