A recurrent cycle consistency loss for progressive face-to-face synthesis

04/14/2020
by   Enrique Sanchez, et al.
0

This paper addresses a major flaw of the cycle consistency loss when used to preserve the input appearance in the face-to-face synthesis domain. In particular, we show that the images generated by a network trained using this loss conceal a noise that hinders their use for further tasks. To overcome this limitation, we propose a ”recurrent cycle consistency loss" which for different sequences of target attributes minimises the distance between the output images, independent of any intermediate step. We empirically validate not only that our loss enables the re-use of generated images, but that it also improves their quality. In addition, we propose the very first network that covers the task of unconstrained landmark-guided face-to-face synthesis. Contrary to previous works, our proposed approach enables the transfer of a particular set of input features to a large span of poses and expressions, whereby the target landmarks become the ground-truth points. We then evaluate the consistency of our proposed approach to synthesise faces at the target landmarks. To the best of our knowledge, we are the first to propose a loss to overcome the limitation of the cycle consistency loss, and the first to propose an ”in-the-wild” landmark guided synthesis approach. Code and models for this paper can be found in https://github.com/ESanchezLozano/GANnotation

READ FULL TEXT

page 1

page 2

page 5

page 7

page 8

research
11/08/2018

Triple consistency loss for pairing distributions in GAN-based face synthesis

Generative Adversarial Networks have shown impressive results for the ta...
research
07/02/2019

Landmark Assisted CycleGAN for Cartoon Face Generation

In this paper, we are interested in generating an cartoon face of a pers...
research
10/10/2021

Fine-grained Identity Preserving Landmark Synthesis for Face Reenactment

Recent face reenactment works are limited by the coarse reference landma...
research
09/19/2023

Unsupervised Landmark Discovery Using Consistency Guided Bottleneck

We study a challenging problem of unsupervised discovery of object landm...
research
11/26/2019

LaFIn: Generative Landmark Guided Face Inpainting

It is challenging to inpaint face images in the wild, due to the large v...
research
05/09/2019

Cycle-IR: Deep Cyclic Image Retargeting

Supervised deep learning techniques have achieved great success in vario...
research
06/29/2020

Unsupervised Landmark Learning from Unpaired Data

Recent attempts for unsupervised landmark learning leverage synthesized ...

Please sign up or login with your details

Forgot password? Click here to reset