Unsupervised Image Transformation Learning via Generative Adversarial Networks

03/13/2021
by   Kaiwen Zha, et al.
23

In this work, we study the image transformation problem by learning the underlying transformations from a collection of images using Generative Adversarial Networks (GANs). Specifically, we propose an unsupervised learning framework, termed as TrGAN, to project images onto a transformation space that is shared by the generator and the discriminator. Any two points in this projected space define a transformation that can guide the image generation process, leading to continuous semantic change. By projecting a pair of images onto the transformation space, we are able to adequately extract the semantic variation between them and further apply the extracted semantic to facilitating image editing, including not only transferring image styles (e.g., changing day to night) but also manipulating image contents (e.g., adding clouds in the sky). Code and models are available at https://genforce.github.io/trgan.

READ FULL TEXT

page 1

page 5

page 6

page 7

page 8

page 12

page 13

page 14

research
05/18/2021

Decorating Your Own Bedroom: Locally Controlling Image Generation with Generative Adversarial Networks

Generative Adversarial Networks (GANs) have made great success in synthe...
research
09/27/2017

Generative Adversarial Networks with Inverse Transformation Unit

In this paper we introduce a new structure to Generative Adversarial Net...
research
04/01/2021

Linear Semantics in Generative Adversarial Networks

Generative Adversarial Networks (GANs) are able to generate high-quality...
research
08/29/2023

Learning Modulated Transformation in GANs

The success of style-based generators largely benefits from style modula...
research
01/11/2019

CSGAN: Cyclic-Synthesized Generative Adversarial Networks for Image-to-Image Transformation

The primary motivation of Image-to-Image Transformation is to convert an...
research
07/31/2022

Design What You Desire: Icon Generation from Orthogonal Application and Theme Labels

Generative adversarial networks (GANs) have been trained to be professio...
research
04/11/2018

Ranking Generative Adversarial Networks: Subjective Control over Semantic Image Attributes

In this paper, we investigate the use of generative adversarial networks...

Please sign up or login with your details

Forgot password? Click here to reset