Disentangled Unsupervised Image Translation via Restricted Information Flow

11/26/2021
by   Ben Usman, et al.
0

Unsupervised image-to-image translation methods aim to map images from one domain into plausible examples from another domain while preserving structures shared across two domains. In the many-to-many setting, an additional guidance example from the target domain is used to determine domain-specific attributes of the generated image. In the absence of attribute annotations, methods have to infer which factors are specific to each domain from data during training. Many state-of-art methods hard-code the desired shared-vs-specific split into their architecture, severely restricting the scope of the problem. In this paper, we propose a new method that does not rely on such inductive architectural biases, and infers which attributes are domain-specific from data by constraining information flow through the network using translation honesty losses and a penalty on the capacity of domain-specific embedding. We show that the proposed method achieves consistently high manipulation accuracy across two synthetic and one natural dataset spanning a wide variety of domain-specific and shared attributes.

READ FULL TEXT

page 28

page 29

page 31

page 32

page 33

page 35

page 36

page 37

research
03/29/2021

Evaluation of Correctness in Unsupervised Many-to-Many Image Translation

Given an input image from a source domain and a "guidance" image from a ...
research
11/29/2018

Unsupervised Image-to-Image Translation Using Domain-Specific Variational Information Bound

Unsupervised image-to-image translation is a class of computer vision pr...
research
03/25/2021

Scaling-up Disentanglement for Image Translation

Image translation methods typically aim to manipulate a set of labeled a...
research
12/06/2017

Unsupervised Multi-Domain Image Translation with Domain-Specific Encoders/Decoders

Unsupervised Image-to-Image Translation achieves spectacularly advanced ...
research
04/28/2020

Neural Hair Rendering

In this paper, we propose a generic neural-based hair rendering pipeline...
research
08/02/2018

Diverse Image-to-Image Translation via Disentangled Representations

Image-to-image translation aims to learn the mapping between two visual ...
research
11/02/2021

StyleGAN of All Trades: Image Manipulation with Only Pretrained StyleGAN

Recently, StyleGAN has enabled various image manipulation and editing ta...

Please sign up or login with your details

Forgot password? Click here to reset