Image-to-image Mapping with Many Domains by Sparse Attribute Transfer

06/23/2020
by   Matthew Amodio, et al.
5

Unsupervised image-to-image translation consists of learning a pair of mappings between two domains without known pairwise correspondences between points. The current convention is to approach this task with cycle-consistent GANs: using a discriminator to encourage the generator to change the image to match the target domain, while training the generator to be inverted with another mapping. While ending up with paired inverse functions may be a good end result, enforcing this restriction at all times during training can be a hindrance to effective modeling. We propose an alternate approach that directly restricts the generator to performing a simple sparse transformation in a latent layer, motivated by recent work from cognitive neuroscience suggesting an architectural prior on representations corresponding to consciousness. Our biologically motivated approach leads to representations more amenable to transformation by disentangling high-level abstract concepts in the latent space. We demonstrate that image-to-image domain translation with many different domains can be learned more effectively with our architecturally constrained, simple transformation than with previous unconstrained architectures that rely on a cycle-consistency loss.

READ FULL TEXT

page 6

page 8

research
02/25/2019

TraVeLGAN: Image-to-image Translation by Transformation Vector Learning

Interest in image-to-image translation has grown substantially in recent...
research
03/30/2017

Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks

Image-to-image translation is a class of vision and graphics problems wh...
research
03/15/2020

GMM-UNIT: Unsupervised Multi-Domain and Multi-Modal Image-to-Image Translation via Attribute Gaussian Mixture Modeling

Unsupervised image-to-image translation (UNIT) aims at learning a mappin...
research
11/09/2022

ParGAN: Learning Real Parametrizable Transformations

Current methods for image-to-image translation produce compelling result...
research
03/20/2020

Unsupervised Latent Space Translation Network

One task that is often discussed in a computer vision is the mapping of ...
research
12/25/2019

Asymmetric GAN for Unpaired Image-to-image Translation

Unpaired image-to-image translation problem aims to model the mapping fr...
research
08/13/2020

Powers of layers for image-to-image translation

We propose a simple architecture to address unpaired image-to-image tran...

Please sign up or login with your details

Forgot password? Click here to reset