Informative Sample Mining Network for Multi-Domain Image-to-Image Translation

01/05/2020
by   Jie Cao, et al.
5

The performance of multi-domain image-to-image translation has been significantly improved by recent progress in deep generative models. Existing approaches can use a unified model to achieve translations between all the visual domains. However, their outcomes are far from satisfying when there are large domain variations. In this paper, we reveal that improving the strategy of sample selection is an effective solution. To select informative samples, we dynamically estimate sample importance during the training of Generative Adversarial Networks, presenting Informative Sample Mining Network. We theoretically analyze the relationship between the sample importance and the prediction of the global optimal discriminator. Then a practical importance estimation function based on general discriminators is derived. In addition, we propose a novel multi-stage sample training scheme to reduce sample hardness while preserving sample informativeness. Extensive experiments on a wide range of specific image-to-image translation tasks are conducted, and the results demonstrate our superiority over current state-of-the-art methods.

READ FULL TEXT

page 12

page 13

page 14

page 15

page 16

page 17

page 19

page 21

research
11/19/2018

Show, Attend and Translate: Unpaired Multi-Domain Image-to-Image Translation with Visual Attention

Recently unpaired multi-domain image-to-image translation has attracted ...
research
11/28/2019

An Efficient Multi-Domain Framework for Image-to-Image Translation

Existing approaches have been proposed to tackle unsupervised image-to-i...
research
04/14/2019

Biphasic Learning of GANs for High-Resolution Image-to-Image Translation

Despite that the performance of image-to-image translation has been sign...
research
01/06/2019

Segmentation Guided Image-to-Image Translation with Adversarial Networks

Recently image-to-image translation has received increasing attention, w...
research
01/11/2021

Multi-Domain Image-to-Image Translation with Adaptive Inference Graph

In this work, we address the problem of multi-domain image-to-image tran...
research
06/19/2018

Theoretical Analysis of Image-to-Image Translation with Adversarial Learning

Recently, a unified model for image-to-image translation tasks within ad...
research
11/24/2019

EDIT: Exemplar-Domain Aware Image-to-Image Translation

Image-to-image translation is to convert an image of the certain style t...

Please sign up or login with your details

Forgot password? Click here to reset