MARA-Net: Single Image Deraining Network with Multi-level connections and Adaptive Regional Attentions

by   Yeachan Park, et al.

Removing rain streaks from single images is an important problem in various computer vision tasks because rain streaks can degrade outdoor images and reduce their visibility. While recent convolutional neural network-based deraining models have succeeded in capturing rain streaks effectively, difficulties in recovering the details in rain-free images still remain. In this paper, we present a multi-level connection and adaptive regional attention network (MARA-Net) to properly restore the original background textures in rainy images. The first main idea is a multi-level connection design that repeatedly connects multi-level features of the encoder network to the decoder network. Multi-level connections encourage the decoding process to use the feature information of all levels. Channel attention is considered in multi-level connections to learn which level of features is important in the decoding process of the current level. The second main idea is a wide regional non-local block (WRNL). As rain streaks primarily exhibit a vertical distribution, we divide the grid of the image into horizontally-wide patches and apply a non-local operation to each region to explore the rich rain-free background information. Experimental results on both synthetic and real-world rainy datasets demonstrate that the proposed model significantly outperforms existing state-of-the-art models. Furthermore, the results of the joint deraining and segmentation experiment prove that our model contributes effectively to other vision tasks.


page 4

page 7

page 8


Multi-Level Adaptive Region of Interest and Graph Learning for Facial Action Unit Recognition

In facial action unit (AU) recognition tasks, regional feature learning ...

Structure-Preserving Deraining with Residue Channel Prior Guidance

Single image deraining is important for many high-level computer vision ...

MGRR-Net: Multi-level Graph Relational Reasoning Network for Facial Action Units Detection

The Facial Action Coding System (FACS) encodes the action units (AUs) in...

Image Captioning with Integrated Bottom-Up and Multi-level Residual Top-Down Attention for Game Scene Understanding

Image captioning has attracted considerable attention in recent years. H...

MTU-Net: Multi-level TransUNet for Space-based Infrared Tiny Ship Detection

Space-based infrared tiny ship detection aims at separating tiny ships f...

Environmental Sound Classification Based on Multi-temporal Resolution CNN Network Combining with Multi-level Features

Motivated by the fact that characteristics of different sound classes ar...

Deep Mean Maps

The use of distributions and high-level features from deep architecture ...

Please sign up or login with your details

Forgot password? Click here to reset