SeCGAN: Parallel Conditional Generative Adversarial Networks for Face Editing via Semantic Consistency

11/17/2021
by   Jiaze Sun, et al.
1

Semantically guided conditional Generative Adversarial Networks (cGANs) have become a popular approach for face editing in recent years. However, most existing methods introduce semantic masks as direct conditional inputs to the generator and often require the target masks to perform the corresponding translation in the RGB space. We propose SeCGAN, a novel label-guided cGAN for editing face images utilising semantic information without the need to specify target semantic masks. During training, SeCGAN has two branches of generators and discriminators operating in parallel, with one trained to translate RGB images and the other for semantic masks. To bridge the two branches in a mutually beneficial manner, we introduce a semantic consistency loss which constrains both branches to have consistent semantic outputs. Whilst both branches are required during training, the RGB branch is our primary network and the semantic branch is not needed for inference. Our results on CelebA and CelebA-HQ demonstrate that our approach is able to generate facial images with more accurate attributes, outperforming competitive baselines in terms of Target Attribute Recognition Rate whilst maintaining quality metrics such as self-supervised Fréchet Inception Distance and Inception Score.

READ FULL TEXT

page 1

page 3

page 7

page 8

page 12

page 13

research
07/03/2019

Mask Embedding in conditional GAN for Guided Synthesis of High Resolution Images

Recent advancements in conditional Generative Adversarial Networks (cGAN...
research
12/22/2020

GuidedStyle: Attribute Knowledge Guided Style Manipulation for Semantic Face Editing

Although significant progress has been made in synthesizing high-quality...
research
06/12/2022

Analysis of Branch Specialization and its Application in Image Decomposition

Branched neural networks have been used extensively for a variety of tas...
research
05/21/2022

A comprehensive survey on semantic facial attribute editing using generative adversarial networks

Generating random photo-realistic images has experienced tremendous grow...
research
11/30/2018

The GAN that Warped: Semantic Attribute Editing with Unpaired Data

Deep neural networks have recently been used to edit images with great s...
research
06/11/2020

MatchGAN: A Self-Supervised Semi-Supervised Conditional Generative Adversarial Network

We propose a novel self-supervised semi-supervised learning approach for...
research
04/20/2023

FIANCEE: Faster Inference of Adversarial Networks via Conditional Early Exits

Generative DNNs are a powerful tool for image synthesis, but they are li...

Please sign up or login with your details

Forgot password? Click here to reset