Disentangling Domain and Content

02/15/2022
by   Dan-Andrei Iliescu, et al.
0

Many real-world datasets can be divided into groups according to certain salient features (e.g. grouping images by subject, grouping text by font, etc.). Often, machine learning tasks require that these features be represented separately from those manifesting independently of the grouping. For example, image translation entails changing the style of an image while preserving its content. We formalize these two kinds of attributes as two complementary generative factors called "domain" and "content", and address the problem of disentangling them in a fully unsupervised way. To achieve this, we propose a principled, generalizable probabilistic model inspired by the Variational Autoencoder. Our model exhibits state-of-the-art performance on the composite task of generating images by combining the domain of one input with the content of another. Distinctively, it can perform this task in a few-shot, unsupervised manner, without being provided with explicit labelling for either domain or content. The disentangled representations are learned through the combination of a group-wise encoder and a novel domain-confusion loss.

READ FULL TEXT

page 8

page 17

page 18

research
07/15/2020

COCO-FUNIT: Few-Shot Unsupervised Image Translation with a Content Conditioned Style Encoder

Unsupervised image-to-image translation intends to learn a mapping of an...
research
09/28/2018

Open-Ended Content-Style Recombination Via Leakage Filtering

We consider visual domains in which a class label specifies the content ...
research
11/14/2017

XGAN: Unsupervised Image-to-Image Translation for Many-to-Many Mappings

Style transfer usually refers to the task of applying color and texture ...
research
11/27/2020

Frequency Domain Image Translation: More Photo-realistic, Better Identity-preserving

Image-to-image translation aims at translating a particular style of an ...
research
09/07/2018

A simple probabilistic deep generative model for learning generalizable disentangled representations from grouped data

The disentangling problem is to discover multiple complex factors of var...
research
03/05/2019

Unsupervised Domain-Specific Deblurring via Disentangled Representations

Image deblurring aims to restore the latent sharp images from the corres...
research
05/11/2019

Disentangling Content and Style via Unsupervised Geometry Distillation

It is challenging to disentangle an object into two orthogonal spaces of...

Please sign up or login with your details

Forgot password? Click here to reset