Image-to-image Translation via Hierarchical Style Disentanglement

03/02/2021
by   Xinyang Li, et al.
5

Recently, image-to-image translation has made significant progress in achieving both multi-label (, translation conditioned on different labels) and multi-style (, generation with diverse styles) tasks. However, due to the unexplored independence and exclusiveness in the labels, existing endeavors are defeated by involving uncontrolled manipulations to the translation results. In this paper, we propose Hierarchical Style Disentanglement (HiSD) to address this issue. Specifically, we organize the labels into a hierarchical tree structure, in which independent tags, exclusive attributes, and disentangled styles are allocated from top to bottom. Correspondingly, a new translation process is designed to adapt the above structure, in which the styles are identified for controllable translations. Both qualitative and quantitative results on the CelebA-HQ dataset verify the ability of the proposed HiSD. We hope our method will serve as a solid baseline and provide fresh insights with the hierarchically organized annotations for future research in image-to-image translation. The code has been released at https://github.com/imlixinyang/HiSD.

READ FULL TEXT

page 2

page 6

page 11

page 12

page 13

page 14

page 15

page 16

research
02/13/2020

GANILLA: Generative Adversarial Networks for Image to Illustration Translation

In this paper, we explore illustrations in children's books as a new dom...
research
06/11/2021

GANs N' Roses: Stable, Controllable, Diverse Image to Image Translation (works for videos too!)

We show how to learn a map that takes a content code, derived from a fac...
research
07/15/2020

COCO-FUNIT: Few-Shot Unsupervised Image Translation with a Content Conditioned Style Encoder

Unsupervised image-to-image translation intends to learn a mapping of an...
research
04/16/2018

Composable Unpaired Image to Image Translation

There has been remarkable recent work in unpaired image-to-image transla...
research
12/10/2018

SMIT: Stochastic Multi-Label Image-to-Image Translation

Cross-domain mapping has been a very active topic in recent years. Given...
research
03/29/2021

Remote Sensing Image Translation via Style-Based Recalibration Module and Improved Style Discriminator

Existing remote sensing change detection methods are heavily affected by...
research
08/14/2023

Hierarchy Flow For High-Fidelity Image-to-Image Translation

Image-to-image (I2I) translation comprises a wide spectrum of tasks. Her...

Please sign up or login with your details

Forgot password? Click here to reset