Unsupervised Neural Rendering for Image Hazing

07/14/2021
by   Boyun Li, et al.
0

Image hazing aims to render a hazy image from a given clean one, which could be applied to a variety of practical applications such as gaming, filming, photographic filtering, and image dehazing. To generate plausible haze, we study two less-touched but challenging problems in hazy image rendering, namely, i) how to estimate the transmission map from a single image without auxiliary information, and ii) how to adaptively learn the airlight from exemplars, i.e., unpaired real hazy images. To this end, we propose a neural rendering method for image hazing, dubbed as HazeGEN. To be specific, HazeGEN is a knowledge-driven neural network which estimates the transmission map by leveraging a new prior, i.e., there exists the structure similarity (e.g., contour and luminance) between the transmission map and the input clean image. To adaptively learn the airlight, we build a neural module based on another new prior, i.e., the rendered hazy image and the exemplar are similar in the airlight distribution. To the best of our knowledge, this could be the first attempt to deeply rendering hazy images in an unsupervised fashion. Comparing with existing haze generation methods, HazeGEN renders the hazy images in an unsupervised, learnable, and controllable manner, thus avoiding the labor-intensive efforts in paired data collection and the domain-shift issue in haze generation. Extensive experiments show the promising performance of our method comparing with some baselines in both qualitative and quantitative comparisons. The code will be released on GitHub after acceptance.

READ FULL TEXT

page 2

page 3

page 8

research
06/30/2020

You Only Look Yourself: Unsupervised and Untrained Single Image Dehazing Neural Network

In this paper, we study two challenging and less-touched problems in sin...
research
03/21/2022

Underwater Light Field Retention : Neural Rendering for Underwater Imaging

Underwater Image Rendering aims to generate a true-to-life underwater im...
research
06/18/2020

Neural Graphics Pipeline for Controllable Image Generation

We present Neural Graphics Pipeline (NGP), a hybrid generative model tha...
research
11/10/2021

Single image dehazing via combining the prior knowledge and CNNs

Aiming at the existing single image haze removal algorithms, which are b...
research
11/21/2018

Unsupervised Single Image Deraining with Self-supervised Constraints

Most existing single image deraining methods require learning supervised...
research
04/09/2019

Rain O'er Me: Synthesizing real rain to derain with data distillation

We present a supervised technique for learning to remove rain from image...
research
04/09/2019

A Non-linear Differential CNN-Rendering Module for 3D Data Enhancement

In this work we introduce a differential rendering module which allows n...

Please sign up or login with your details

Forgot password? Click here to reset