A Novel BiLevel Paradigm for Image-to-Image Translation

04/18/2019
by   Liqian Ma, et al.
10

Image-to-image (I2I) translation is a pixel-level mapping that requires a large number of paired training data and often suffers from the problems of high diversity and strong category bias in image scenes. In order to tackle these problems, we propose a novel BiLevel (BiL) learning paradigm that alternates the learning of two models, respectively at an instance-specific (IS) and a general-purpose (GP) level. In each scene, the IS model learns to maintain the specific scene attributes. It is initialized by the GP model that learns from all the scenes to obtain the generalizable translation knowledge. This GP initialization gives the IS model an efficient starting point, thus enabling its fast adaptation to the new scene with scarce training data. We conduct extensive I2I translation experiments on human face and street view datasets. Quantitative results validate that our approach can significantly boost the performance of classical I2I translation models, such as PG2 and Pix2Pix. Our visualization results show both higher image quality and more appropriate instance-specific details, e.g., the translated image of a person looks more like that person in terms of identity.

READ FULL TEXT

page 1

page 3

page 7

page 8

research
04/09/2020

TuiGAN: Learning Versatile Image-to-Image Translation with Two Unpaired Images

An unsupervised image-to-image translation (UI2I) task deals with learni...
research
05/21/2019

Toward Learning a Unified Many-to-Many Mapping for Diverse Image Translation

Image-to-image translation, which translates input images to a different...
research
08/24/2023

Scenimefy: Learning to Craft Anime Scene via Semi-Supervised Image-to-Image Translation

Automatic high-quality rendering of anime scenes from complex real-world...
research
06/07/2023

GP-UNIT: Generative Prior for Versatile Unsupervised Image-to-Image Translation

Recent advances in deep learning have witnessed many successful unsuperv...
research
04/14/2019

Biphasic Learning of GANs for High-Resolution Image-to-Image Translation

Despite that the performance of image-to-image translation has been sign...
research
06/02/2020

Ear2Face: Deep Biometric Modality Mapping

In this paper, we explore the correlation between different visual biome...

Please sign up or login with your details

Forgot password? Click here to reset