LSC-GAN: Latent Style Code Modeling for Continuous Image-to-image Translation

by   Qiusheng Huang, et al.

Image-to-image (I2I) translation is usually carried out among discrete domains. However, image domains, often corresponding to a physical value, are usually continuous. In other words, images gradually change with the value, and there exists no obvious gap between different domains. This paper intends to build the model for I2I translation among continuous varying domains. We first divide the whole domain coverage into discrete intervals, and explicitly model the latent style code for the center of each interval. To deal with continuous translation, we design the editing modules, changing the latent style code along two directions. These editing modules help to constrain the codes for domain centers during training, so that the model can better understand the relation among them. To have diverse results, the latent style code is further diversified with either the random noise or features from the reference image, giving the individual style code to the decoder for label-based or reference-based synthesis. Extensive experiments on age and viewing angle translation show that the proposed method can achieve high-quality results, and it is also flexible for users.


page 1

page 4

page 7

page 8

page 9

page 10

page 11

page 12


Bridging the Gap between Label- and Reference-based Synthesis in Multi-attribute Image-to-Image Translation

The image-to-image translation (I2IT) model takes a target label or a re...

Style Transformer for Image Inversion and Editing

Existing GAN inversion methods fail to provide latent codes for reliable...

Region and Object based Panoptic Image Synthesis through Conditional GANs

Image-to-image translation is significant to many computer vision and ma...

Unpaired Image-to-Image Translation via Latent Energy Transport

Image-to-image translation aims to preserve source contents while transl...

Integrated unpaired appearance-preserving shape translation across domains

We address the problem of un-supervised geometric image-to-image transla...

Nested Scale Editing for Conditional Image Synthesis

We propose an image synthesis approach that provides stratified navigati...

Stylize Aesthetic QR Code

With the continued proliferation of smart mobile devices, Quick Response...

Please sign up or login with your details

Forgot password? Click here to reset