DeepAI
Log In Sign Up

Semi-MoreGAN: A New Semi-supervised Generative Adversarial Network for Mixture of Rain Removal

04/28/2022
by   Yiyang Shen, et al.
2

Rain is one of the most common weather which can completely degrade the image quality and interfere with the performance of many computer vision tasks, especially under heavy rain conditions. We observe that: (i) rain is a mixture of rain streaks and rainy haze; (ii) the scene depth determines the intensity of rain streaks and the transformation into the rainy haze; (iii) most existing deraining methods are only trained on synthetic rainy images, and hence generalize poorly to the real-world scenes. Motivated by these observations, we propose a new SEMI-supervised Mixture Of rain REmoval Generative Adversarial Network (Semi-MoreGAN), which consists of four key modules: (I) a novel attentional depth prediction network to provide precise depth estimation; (ii) a context feature prediction network composed of several well-designed detailed residual blocks to produce detailed image context features; (iii) a pyramid depth-guided non-local network to effectively integrate the image context with the depth information, and produce the final rain-free images; and (iv) a comprehensive semi-supervised loss function to make the model not limited to synthetic datasets but generalize smoothly to real-world heavy rainy scenes. Extensive experiments show clear improvements of our approach over twenty representative state-of-the-arts on both synthetic and real-world rainy images.

READ FULL TEXT

page 2

page 6

page 8

page 9

page 10

page 11

page 14

page 16

10/28/2022

Semi-UFormer: Semi-supervised Uncertainty-aware Transformer for Image Dehazing

Image dehazing is fundamental yet not well-solved in computer vision. Mo...
05/21/2020

MBA-RainGAN: Multi-branch Attention Generative Adversarial Network for Mixture of Rain Removal from Single Images

Rain severely hampers the visibility of scene objects when images are ca...
01/23/2020

Semi-DerainGAN: A New Semi-supervised Single Image Deraining Network

Removing the rain streaks from single image is still a challenging task,...
04/06/2022

Semi-DRDNet Semi-supervised Detail-recovery Image Deraining Network via Unpaired Contrastive Learning

The intricacy of rainy image contents often leads cutting-edge deraining...
08/04/2019

ARGAN: Attentive Recurrent Generative Adversarial Network for Shadow Detection and Removal

In this paper we propose an attentive recurrent generative adversarial n...
10/11/2021

UnfairGAN: An Enhanced Generative Adversarial Network for Raindrop Removal from A Single Image

Image deraining is a new challenging problem in real-world applications,...
09/18/2022

RVSL: Robust Vehicle Similarity Learning in Real Hazy Scenes Based on Semi-supervised Learning

Recently, vehicle similarity learning, also called re-identification (Re...