Discriminative Region Proposal Adversarial Networks for High-Quality Image-to-Image Translation

11/27/2017
by   Chao Wang, et al.
0

Image-to-image translation has been made much progress with embracing Generative Adversarial Networks (GANs). However, it's still very challenging for translation tasks that require high-quality, especially at high-resolution and photo-reality. In this paper, we present Discriminative Region Proposal Adversarial Networks (DRPANs) with three components: a generator, a discriminator and a reviser, for high-quality image-to-image translation. To reduce the artifacts and blur problems while translation, based on GAN, we explore a patch discriminator to find and extract the most artificial image patch by sliding the output score map with a window, and map the proposed image patch onto the synthesized fake image as our discriminative region. We then mask the corresponding real image using the discriminative region to obtain a fake-mask real image. For providing constructive revisions to generator, we propose a reviser for GANs to distinguish the real from the fake-mask real for producing realistic details and serve as auxiliaries to generate high-quality translation results. Experiments on a variety of image-to-image translation tasks and datasets validate that our method outperforms state-of-the-art translation methods for producing high-quality translation results in terms of both human perceptual studies and automatic quantitative measures.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

page 8

research
06/18/2022

Multi-Modality Image Inpainting using Generative Adversarial Networks

Deep learning techniques, especially Generative Adversarial Networks (GA...
research
11/29/2017

Photo-to-Caricature Translation on Faces in the Wild

Recently, image-to-image translation has been made much progress owing t...
research
01/24/2019

Generative Adversarial Network with Multi-Branch Discriminator for Cross-Species Image-to-Image Translation

Current approaches have made great progress on image-to-image translatio...
research
02/28/2019

Two-phase Hair Image Synthesis by Self-Enhancing Generative Model

Generating plausible hair image given limited guidance, such as sparse s...
research
02/29/2020

Augmented Cyclic Consistency Regularization for Unpaired Image-to-Image Translation

Unpaired image-to-image (I2I) translation has received considerable atte...
research
08/24/2023

Scenimefy: Learning to Craft Anime Scene via Semi-Supervised Image-to-Image Translation

Automatic high-quality rendering of anime scenes from complex real-world...
research
07/23/2021

SurfaceNet: Adversarial SVBRDF Estimation from a Single Image

In this paper we present SurfaceNet, an approach for estimating spatiall...

Please sign up or login with your details

Forgot password? Click here to reset