Frequency Domain Image Translation: More Photo-realistic, Better Identity-preserving

11/27/2020
by   Mu Cai, et al.
0

Image-to-image translation aims at translating a particular style of an image to another. The synthesized images can be more photo-realistic and identity-preserving by decomposing the image into content and style in a disentangled manner. While existing models focus on designing specialized network architecture to separate the two components, this paper investigates how to explicitly constrain the content and style statistics of images. We achieve this goal by transforming the input image into high frequency and low frequency information, which correspond to the content and style, respectively. We regulate the frequency distribution from two aspects: a) a spatial level restriction to locally restrict the frequency distribution of images; b) a spectral level regulation to enhance the global consistency among images. On multiple datasets we show that the proposed approach consistently leads to significant improvements on top of various state-of-the-art image translation models.

READ FULL TEXT

page 1

page 6

page 7

page 8

page 11

page 12

page 13

research
07/09/2020

Improving Style-Content Disentanglement in Image-to-Image Translation

Unsupervised image-to-image translation methods have achieved tremendous...
research
07/15/2020

COCO-FUNIT: Few-Shot Unsupervised Image Translation with a Content Conditioned Style Encoder

Unsupervised image-to-image translation intends to learn a mapping of an...
research
07/23/2021

Image-to-Image Translation with Low Resolution Conditioning

Most image-to-image translation methods focus on learning mappings acros...
research
11/29/2019

Unpaired Image Translation via Adaptive Convolution-based Normalization

Disentangling content and style information of an image has played an im...
research
02/15/2022

Disentangling Domain and Content

Many real-world datasets can be divided into groups according to certain...
research
05/11/2019

Disentangling Content and Style via Unsupervised Geometry Distillation

It is challenging to disentangle an object into two orthogonal spaces of...
research
03/09/2021

Content-Preserving Unpaired Translation from Simulated to Realistic Ultrasound Images

Interactive simulation of ultrasound imaging greatly facilitates sonogra...

Please sign up or login with your details

Forgot password? Click here to reset