Level-aware Haze Image Synthesis by Self-Supervised Content-Style Disentanglement

03/11/2021
by   Chi Zhang, et al.
19

The key procedure of haze image translation through adversarial training lies in the disentanglement between the feature only involved in haze synthesis, i.e.style feature, and the feature representing the invariant semantic content, i.e. content feature. Previous methods separate content feature apart by utilizing it to classify haze image during the training process. However, in this paper we recognize the incompleteness of the content-style disentanglement in such technical routine. The flawed style feature entangled with content information inevitably leads the ill-rendering of the haze images. To address, we propose a self-supervised style regression via stochastic linear interpolation to reduce the content information in style feature. The ablative experiments demonstrate the disentangling completeness and its superiority in level-aware haze image synthesis. Moreover, the generated haze data are applied in the testing generalization of vehicle detectors. Further study between haze-level and detection performance shows that haze has obvious impact on the generalization of the vehicle detectors and such performance degrading level is linearly correlated to the haze-level, which, in turn, validates the effectiveness of the proposed method.

READ FULL TEXT

page 1

page 3

page 7

page 8

page 10

page 11

page 12

page 14

research
12/16/2020

Self-Supervised Sketch-to-Image Synthesis

Imagining a colored realistic image from an arbitrarily drawn sketch is ...
research
07/23/2021

RewriteNet: Realistic Scene Text Image Generation via Editing Text in Real-world Image

Scene text editing (STE), which converts a text in a scene image into th...
research
10/31/2020

Pose Randomization for Weakly Paired Image Style Translation

Utilizing the trained model under different conditions without data anno...
research
08/09/2017

Weakly- and Self-Supervised Learning for Content-Aware Deep Image Retargeting

This paper proposes a weakly- and self-supervised deep convolutional neu...
research
11/29/2019

Unpaired Image Translation via Adaptive Convolution-based Normalization

Disentangling content and style information of an image has played an im...
research
01/14/2020

Adversarial Disentanglement with Grouped Observations

We consider the disentanglement of the representations of the relevant a...
research
12/30/2022

DGFont++: Robust Deformable Generative Networks for Unsupervised Font Generation

Automatic font generation without human experts is a practical and signi...

Please sign up or login with your details

Forgot password? Click here to reset