DeepAI AI Chat
Log In Sign Up

Unsupervised Image-to-Image Translation Using Domain-Specific Variational Information Bound

11/29/2018
by   Hadi Kazemi, et al.
West Virginia University
0

Unsupervised image-to-image translation is a class of computer vision problems which aims at modeling conditional distribution of images in the target domain, given a set of unpaired images in the source and target domains. An image in the source domain might have multiple representations in the target domain. Therefore, ambiguity in modeling of the conditional distribution arises, specially when the images in the source and target domains come from different modalities. Current approaches mostly rely on simplifying assumptions to map both domains into a shared-latent space. Consequently, they are only able to model the domain-invariant information between the two modalities. These approaches usually fail to model domain-specific information which has no representation in the target domain. In this work, we propose an unsupervised image-to-image translation framework which maximizes a domain-specific variational information bound and learns the target domain-invariant representation of the two domain. The proposed framework makes it possible to map a single source image into multiple images in the target domain, utilizing several target domain-specific codes sampled randomly from the prior distribution, or extracted from reference images.

READ FULL TEXT
04/12/2018

Multimodal Unsupervised Image-to-Image Translation

Unsupervised image-to-image translation is an important and challenging ...
05/01/2018

Conditional Image-to-Image Translation

Image-to-image translation tasks have been widely investigated with Gene...
03/29/2021

Evaluation of Correctness in Unsupervised Many-to-Many Image Translation

Given an input image from a source domain and a "guidance" image from a ...
11/26/2021

Disentangled Unsupervised Image Translation via Restricted Information Flow

Unsupervised image-to-image translation methods aim to map images from o...
05/22/2018

Distribution Matching Losses Can Hallucinate Features in Medical Image Translation

This paper discusses how distribution matching losses, such as those use...
05/29/2019

Image-to-Image Translation with Multi-Path Consistency Regularization

Image translation across different domains has attracted much attention ...
10/11/2021

Bridging the Gap between Label- and Reference-based Synthesis in Multi-attribute Image-to-Image Translation

The image-to-image translation (I2IT) model takes a target label or a re...