LSC-GAN: Latent Style Code Modeling for Continuous Image-to-image Translation

10/11/2021
by   Qiusheng Huang, et al.
0

Image-to-image (I2I) translation is usually carried out among discrete domains. However, image domains, often corresponding to a physical value, are usually continuous. In other words, images gradually change with the value, and there exists no obvious gap between different domains. This paper intends to build the model for I2I translation among continuous varying domains. We first divide the whole domain coverage into discrete intervals, and explicitly model the latent style code for the center of each interval. To deal with continuous translation, we design the editing modules, changing the latent style code along two directions. These editing modules help to constrain the codes for domain centers during training, so that the model can better understand the relation among them. To have diverse results, the latent style code is further diversified with either the random noise or features from the reference image, giving the individual style code to the decoder for label-based or reference-based synthesis. Extensive experiments on age and viewing angle translation show that the proposed method can achieve high-quality results, and it is also flexible for users.

READ FULL TEXT

page 1

page 4

page 7

page 8

page 9

page 10

page 11

page 12

research
10/11/2021

Bridging the Gap between Label- and Reference-based Synthesis in Multi-attribute Image-to-Image Translation

The image-to-image translation (I2IT) model takes a target label or a re...
research
03/15/2022

Style Transformer for Image Inversion and Editing

Existing GAN inversion methods fail to provide latent codes for reliable...
research
12/14/2019

Region and Object based Panoptic Image Synthesis through Conditional GANs

Image-to-image translation is significant to many computer vision and ma...
research
12/01/2020

Unpaired Image-to-Image Translation via Latent Energy Transport

Image-to-image translation aims to preserve source contents while transl...
research
12/05/2018

Integrated unpaired appearance-preserving shape translation across domains

We address the problem of un-supervised geometric image-to-image transla...
research
06/03/2020

Nested Scale Editing for Conditional Image Synthesis

We propose an image synthesis approach that provides stratified navigati...
research
03/03/2018

Stylize Aesthetic QR Code

With the continued proliferation of smart mobile devices, Quick Response...

Please sign up or login with your details

Forgot password? Click here to reset