TSIT: A Simple and Versatile Framework for Image-to-Image Translation

07/23/2020
by   Liming Jiang, et al.
17

We introduce a simple and versatile framework for image-to-image translation. We unearth the importance of normalization layers, and provide a carefully designed two-stream generative model with newly proposed feature transformations in a coarse-to-fine fashion. This allows multi-scale semantic structure information and style representation to be effectively captured and fused by the network, permitting our method to scale to various tasks in both unsupervised and supervised settings. No additional constraints (e.g., cycle consistency) are needed, contributing to a very clean and simple method. Multi-modal image synthesis with arbitrary style control is made possible. A systematic study compares the proposed method with several state-of-the-art task-specific baselines, verifying its effectiveness in both perceptual quality and quantitative evaluations.

READ FULL TEXT

page 1

page 10

page 11

page 12

page 13

page 14

page 24

page 25

research
07/27/2022

Vector Quantized Image-to-Image Translation

Current image-to-image translation methods formulate the task with condi...
research
04/07/2022

Unsupervised Image-to-Image Translation with Generative Prior

Unsupervised image-to-image translation aims to learn the translation be...
research
08/03/2020

Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation

We present a generic image-to-image translation framework, Pixel2Style2P...
research
08/24/2022

Unsupervised Structure-Consistent Image-to-Image Translation

The Swapping Autoencoder achieved state-of-the-art performance in deep i...
research
11/10/2021

Palette: Image-to-Image Diffusion Models

We introduce Palette, a simple and general framework for image-to-image ...
research
09/28/2019

Semantic Example Guided Image-to-Image Translation

Many image-to-image (I2I) translation problems are in nature of high div...
research
06/26/2018

Multi-Mapping Image-to-Image Translation with Central Biasing Normalization

Recent image-to-image translation tasks attempt to extend the model from...

Please sign up or login with your details

Forgot password? Click here to reset