Semi-MoreGAN: A New Semi-supervised Generative Adversarial Network for Mixture of Rain Removal

by   Yiyang Shen, et al.

Rain is one of the most common weather which can completely degrade the image quality and interfere with the performance of many computer vision tasks, especially under heavy rain conditions. We observe that: (i) rain is a mixture of rain streaks and rainy haze; (ii) the scene depth determines the intensity of rain streaks and the transformation into the rainy haze; (iii) most existing deraining methods are only trained on synthetic rainy images, and hence generalize poorly to the real-world scenes. Motivated by these observations, we propose a new SEMI-supervised Mixture Of rain REmoval Generative Adversarial Network (Semi-MoreGAN), which consists of four key modules: (I) a novel attentional depth prediction network to provide precise depth estimation; (ii) a context feature prediction network composed of several well-designed detailed residual blocks to produce detailed image context features; (iii) a pyramid depth-guided non-local network to effectively integrate the image context with the depth information, and produce the final rain-free images; and (iv) a comprehensive semi-supervised loss function to make the model not limited to synthetic datasets but generalize smoothly to real-world heavy rainy scenes. Extensive experiments show clear improvements of our approach over twenty representative state-of-the-arts on both synthetic and real-world rainy images.


page 2

page 6

page 8

page 9

page 10

page 11

page 14

page 16


Semi-UFormer: Semi-supervised Uncertainty-aware Transformer for Image Dehazing

Image dehazing is fundamental yet not well-solved in computer vision. Mo...

MBA-RainGAN: Multi-branch Attention Generative Adversarial Network for Mixture of Rain Removal from Single Images

Rain severely hampers the visibility of scene objects when images are ca...

Semi-DerainGAN: A New Semi-supervised Single Image Deraining Network

Removing the rain streaks from single image is still a challenging task,...

Uni-Removal: A Semi-Supervised Framework for Simultaneously Addressing Multiple Degradations in Real-World Images

Removing multiple degradations, such as haze, rain, and blur, from real-...

ARGAN: Attentive Recurrent Generative Adversarial Network for Shadow Detection and Removal

In this paper we propose an attentive recurrent generative adversarial n...

Joint Depth Estimation and Mixture of Rain Removal From a Single Image

Rainy weather significantly deteriorates the visibility of scene objects...

UnfairGAN: An Enhanced Generative Adversarial Network for Raindrop Removal from A Single Image

Image deraining is a new challenging problem in real-world applications,...

Please sign up or login with your details

Forgot password? Click here to reset