DeepAI AI Chat
Log In Sign Up

Attentive Generative Adversarial Network for Raindrop Removal from a Single Image

11/28/2017
by   Rui Qian, et al.
0

Raindrops adhered to a glass window or camera lens can severely hamper the visibility of a background scene, and degrade an image considerably. In this paper, we address the problem by visually removing raindrops, and thus transforming a raindrop degraded image into a clean image. The problem is intractable, since first which regions are occluded by raindrops are not given. Second, the information about the background scene of the occluded regions for most part is completely lost. To resolve the problem, we apply an attentive generative network using the idea of adversarial training. Our main idea is to inject visual attention into both the generative and discriminative networks. In the training stage, our visual attention is guided by the locations of raindrop regions. Hence, by injecting this, the generative network will pay more attention to the raindrop regions and their surroundings which are the regions we want to modify; and, the discriminative network will be able to assess the local consistency of the restored regions. To our knowledge, this injection of visual attention to both generative and discriminative networks is novel. Our experiments show the effectiveness of our approach, which outperforms the state of the art methods quantitatively and qualitatively.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

page 8

10/31/2018

Visual Attention Network for Low Dose CT

Noise and artifacts are intrinsic to low dose CT (LDCT) data acquisition...
08/04/2019

ARGAN: Attentive Recurrent Generative Adversarial Network for Shadow Detection and Removal

In this paper we propose an attentive recurrent generative adversarial n...
05/21/2020

MBA-RainGAN: Multi-branch Attention Generative Adversarial Network for Mixture of Rain Removal from Single Images

Rain severely hampers the visibility of scene objects when images are ca...
09/03/2020

Adherent Mist and Raindrop Removal from a Single Image Using Attentive Convolutional Network

Temperature difference-induced mist adhered to the windshield, camera le...
12/19/2017

Single Image Deraining using Scale-Aware Multi-Stage Recurrent Network

Given a single input rainy image, our goal is to visually remove rain st...
04/20/2019

Everyone is a Cartoonist: Selfie Cartoonization with Attentive Adversarial Networks

Selfie and cartoon are two popular artistic forms that are widely presen...
11/14/2022

An Inter-observer consistent deep adversarial training for visual scanpath prediction

The visual scanpath is a sequence of points through which the human gaze...