Non-local Channel Aggregation Network for Single Image Rain Removal

03/03/2021
by   Zhipeng Su, et al.
12

Rain streaks showing in images or videos would severely degrade the performance of computer vision applications. Thus, it is of vital importance to remove rain streaks and facilitate our vision systems. While recent convolutinal neural network based methods have shown promising results in single image rain removal (SIRR), they fail to effectively capture long-range location dependencies or aggregate convolutional channel information simultaneously. However, as SIRR is a highly illposed problem, these spatial and channel information are very important clues to solve SIRR. First, spatial information could help our model to understand the image context by gathering long-range dependency location information hidden in the image. Second, aggregating channels could help our model to concentrate on channels more related to image background instead of rain streaks. In this paper, we propose a non-local channel aggregation network (NCANet) to address the SIRR problem. NCANet models 2D rainy images as sequences of vectors in three directions, namely vertical direction, transverse direction and channel direction. Recurrently aggregating information from all three directions enables our model to capture the long-range dependencies in both channels and spaitials locations. Extensive experiments on both heavy and light rain image data sets demonstrate the effectiveness of the proposed NCANet model.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 7

page 9

page 12

research
09/04/2021

Sparse Spatial Attention Network for Semantic Segmentation

The spatial attention mechanism captures long-range dependencies by aggr...
research
04/05/2021

Non-Homogeneous Haze Removal via Artificial Scene Prior and Bidimensional Graph Reasoning

Due to the lack of natural scene and haze prior information, it is great...
research
11/24/2018

A^2Net: Adjacent Aggregation Networks for Image Raindrop Removal

Existing methods for single images raindrop removal either have poor rob...
research
12/17/2020

Semi-Global Shape-aware Network

Non-local operations are usually used to capture long-range dependencies...
research
04/04/2023

Robust Outlier Rejection for 3D Registration with Variational Bayes

Learning-based outlier (mismatched correspondence) rejection for robust ...
research
08/03/2022

LSSANet: A Long Short Slice-Aware Network for Pulmonary Nodule Detection

Convolutional neural networks (CNNs) have been demonstrated to be highly...
research
11/02/2022

SufrinNet: Toward Sufficient Cross-View Interaction for Stereo Image Enhancement in The Dark

Low-light stereo image enhancement (LLSIE) is a relatively new task to e...

Please sign up or login with your details

Forgot password? Click here to reset