Guided Disentanglement in Generative Networks

07/29/2021
by   Fabio Pizzati, et al.
13

Image-to-image translation (i2i) networks suffer from entanglement effects in presence of physics-related phenomena in target domain (such as occlusions, fog, etc), thus lowering the translation quality and variability. In this paper, we present a comprehensive method for disentangling physics-based traits in the translation, guiding the learning process with neural or physical models. For the latter, we integrate adversarial estimation and genetic algorithms to correctly achieve disentanglement. The results show our approach dramatically increase performances in many challenging scenarios for image translation.

READ FULL TEXT

page 1

page 8

page 9

page 10

page 12

page 13

page 15

research
08/08/2020

Multimodal Image-to-Image Translation via Mutual Information Estimation and Maximization

In this paper, we present a novel framework that can achieve multimodal ...
research
05/23/2023

Variational Bayesian Framework for Advanced Image Generation with Domain-Related Variables

Deep generative models (DGMs) and their conditional counterparts provide...
research
08/02/2021

An Efficient Image-to-Image Translation HourGlass-based Architecture for Object Pushing Policy Learning

Humans effortlessly solve pushing tasks in everyday life but unlocking t...
research
12/24/2018

Latent Filter Scaling for Multimodal Unsupervised Image-to-Image Translation

In multimodal unsupervised image-to-image translation tasks, the goal is...
research
03/11/2021

CoMoGAN: continuous model-guided image-to-image translation

CoMoGAN is a continuous GAN relying on the unsupervised reorganization o...
research
10/23/2019

Domain Bridge for Unpaired Image-to-Image Translation and Unsupervised Domain Adaptation

Image-to-image translation architectures may have limited effectiveness ...
research
05/15/2019

Joint haze image synthesis and dehazing with mmd-vae losses

Fog and haze are weathers with low visibility which are adversarial to t...

Please sign up or login with your details

Forgot password? Click here to reset