TRIP: Refining Image-to-Image Translation via Rival Preferences

11/26/2021
by   Yinghua Yao, et al.
0

Relative attribute (RA), referring to the preference over two images on the strength of a specific attribute, can enable fine-grained image-to-image translation due to its rich semantic information. Existing work based on RAs however failed to reconcile the goal for fine-grained translation and the goal for high-quality generation. We propose a new model TRIP to coordinate these two goals for high-quality fine-grained translation. In particular, we simultaneously train two modules: a generator that translates an input image to the desired image with smooth subtle changes with respect to the interested attributes; and a ranker that ranks rival preferences consisting of the input image and the desired image. Rival preferences refer to the adversarial ranking process: (1) the ranker thinks no difference between the desired image and the input image in terms of the desired attributes; (2) the generator fools the ranker to believe that the desired image changes the attributes over the input image as desired. RAs over pairs of real images are introduced to guide the ranker to rank image pairs regarding the interested attributes only. With an effective ranker, the generator would "win" the adversarial game by producing high-quality images that present desired changes over the attributes compared to the input image. The experiments on two face image datasets and one shoe image dataset demonstrate that our TRIP achieves state-of-art results in generating high-fidelity images which exhibit smooth changes over the interested attributes.

READ FULL TEXT

page 7

page 8

page 15

page 16

page 17

page 18

page 19

page 20

research
08/20/2019

RelGAN: Multi-Domain Image-to-Image Translation via Relative Attributes

Multi-domain image-to-image translation has gained increasing attention ...
research
05/08/2019

Generative Reversible Data Hiding by Image to Image Translation via GANs

The traditional reversible data hiding technique is based on cover image...
research
03/28/2018

ELEGANT: Exchanging Latent Encodings with GAN for Transferring Multiple Face Attributes

Recent studies on face attribute transfer have achieved great success, e...
research
01/12/2020

Fine-grained Image-to-Image Transformation towards Visual Recognition

Existing image-to-image transformation approaches primarily focus on syn...
research
08/10/2020

Describe What to Change: A Text-guided Unsupervised Image-to-Image Translation Approach

Manipulating visual attributes of images through human-written text is a...
research
12/19/2016

Semantic Jitter: Dense Supervision for Visual Comparisons via Synthetic Images

Distinguishing subtle differences in attributes is valuable, yet learnin...
research
01/08/2019

Thinking Outside the Pool: Active Training Image Creation for Relative Attributes

Current wisdom suggests more labeled image data is always better, and ob...

Please sign up or login with your details

Forgot password? Click here to reset