Semi-supervised Image Attribute Editing using Generative Adversarial Networks

07/03/2019
by   Yahya Dogan, et al.
2

Image attribute editing is a challenging problem that has been recently studied by many researchers using generative networks. The challenge is in the manipulation of selected attributes of images while preserving the other details. The method to achieve this goal is to find an accurate latent vector representation of an image and a direction corresponding to the attribute. Almost all the works in the literature use labeled datasets in a supervised setting for this purpose. In this study, we introduce an architecture called Cyclic Reverse Generator (CRG), which allows learning the inverse function of the generator accurately via an encoder in an unsupervised setting by utilizing cyclic cost minimization. Attribute editing is then performed using the CRG models for finding desired attribute representations in the latent space. In this work, we use two arbitrary reference images, with and without desired attributes, to compute an attribute direction for editing. We show that the proposed approach performs better in terms of image reconstruction compared to the existing end-to-end generative models both quantitatively and qualitatively. We demonstrate state-of-the-art results on both real images and generated images in MNIST and CelebA datasets.

READ FULL TEXT

page 8

page 10

page 11

page 12

page 13

page 14

research
07/20/2018

Editable Generative Adversarial Networks: Generating and Editing Faces Simultaneously

We propose a novel framework for simultaneously generating and manipulat...
research
06/03/2019

DualDis: Dual-Branch Disentangling with Adversarial Learning

In computer vision, disentangling techniques aim at improving latent rep...
research
05/29/2023

TD-GEM: Text-Driven Garment Editing Mapper

Language-based fashion image editing allows users to try out variations ...
research
03/25/2023

Spatial Latent Representations in Generative Adversarial Networks for Image Generation

In the majority of GAN architectures, the latent space is defined as a s...
research
04/22/2019

STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editing

Arbitrary attribute editing generally can be tackled by incorporating en...
research
04/11/2018

Ranking Generative Adversarial Networks: Subjective Control over Semantic Image Attributes

In this paper, we investigate the use of generative adversarial networks...
research
09/02/2021

Towards disease-aware image editing of chest X-rays

Disease-aware image editing by means of generative adversarial networks ...

Please sign up or login with your details

Forgot password? Click here to reset