DeepAI
Log In Sign Up

MBA-RainGAN: Multi-branch Attention Generative Adversarial Network for Mixture of Rain Removal from Single Images

05/21/2020
by   Yiyang Shen, et al.
13

Rain severely hampers the visibility of scene objects when images are captured through glass in heavily rainy days. We observe three intriguing phenomenons that, 1) rain is a mixture of raindrops, rain streaks and rainy haze; 2) the depth from the camera determines the degrees of object visibility, where objects nearby and faraway are visually blocked by rain streaks and rainy haze, respectively; and 3) raindrops on the glass randomly affect the object visibility of the whole image space. We for the first time consider that, the overall visibility of objects is determined by the mixture of rain (MOR). However, existing solutions and established datasets lack full consideration of the MOR. In this work, we first formulate a new rain imaging model; by then, we enrich the popular RainCityscapes by considering raindrops, named RainCityscapes++. Furthermore, we propose a multi-branch attention generative adversarial network (termed an MBA-RainGAN) to fully remove the MOR. The experiment shows clear visual and numerical improvements of our approach over the state-of-the-arts on RainCityscapes++. The code and dataset will be available.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 8

page 9

page 11

04/28/2022

Semi-MoreGAN: A New Semi-supervised Generative Adversarial Network for Mixture of Rain Removal

Rain is one of the most common weather which can completely degrade the ...
11/28/2017

Attentive Generative Adversarial Network for Raindrop Removal from a Single Image

Raindrops adhered to a glass window or camera lens can severely hamper t...
10/14/2022

See Blue Sky: Deep Image Dehaze Using Paired and Unpaired Training Images

The issue of image haze removal has attracted wide attention in recent y...
06/05/2018

Adversarial Scene Editing: Automatic Object Removal from Weak Supervision

While great progress has been made recently in automatic image manipulat...
03/21/2021

Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priors

Images captured in snowy days suffer from noticeable degradation of scen...
04/09/2022

Unbiased Directed Object Attention Graph for Object Navigation

Object navigation tasks require agents to locate specific objects in unk...