Transforming and Projecting Images into Class-conditional Generative Networks

05/04/2020
by   Minyoung Huh, et al.
1

We present a method for projecting an input image into the space of a class-conditional generative neural network. We propose a method that optimizes for transformation to counteract the model biases in a generative neural networks. Specifically, we demonstrate that one can solve for image translation, scale, and global color transformation, during the projection optimization to address the object-center bias of a Generative Adversarial Network. This projection process poses a difficult optimization problem, and purely gradient-based optimizations fail to find good solutions. We describe a hybrid optimization strategy that finds good projections by estimating transformations and class parameters. We show the effectiveness of our method on real images and further demonstrate how the corresponding projections lead to better edit-ability of these images.

READ FULL TEXT

page 2

page 8

page 10

page 11

page 12

page 14

page 15

page 22

research
05/19/2021

Image to Image Translation : Generating maps from satellite images

Generation of maps from satellite images is conventionally done by a ran...
research
01/26/2019

Points2Pix: 3D Point-Cloud to Image Translation using conditional Generative Adversarial Networks

We present the first approach for 3D point-cloud to image translation ba...
research
02/28/2020

Optical Fiber Channel Modeling Using Conditional Generative Adversarial Network

In this paper, we use CGAN (conditional generative adversarial network) ...
research
01/25/2019

Diversity-Sensitive Conditional Generative Adversarial Networks

We propose a simple yet highly effective method that addresses the mode-...
research
04/11/2018

Projection image-to-image translation in hybrid X-ray/MR imaging

The potential benefit of hybrid X-ray and MR imaging in the intervention...
research
09/27/2017

Generative Adversarial Networks with Inverse Transformation Unit

In this paper we introduce a new structure to Generative Adversarial Net...
research
07/27/2021

Probing neural networks with t-SNE, class-specific projections and a guided tour

We use graphical methods to probe neural nets that classify images. Plot...

Please sign up or login with your details

Forgot password? Click here to reset