MCGKT-Net: Multi-level Context Gating Knowledge Transfer Network for Single Image Deraining

10/19/2020
by   Kohei Yamamichi, et al.
0

Rain streak removal in a single image is a very challenging task due to its ill-posed nature in essence. Recently, the end-to-end learning techniques with deep convolutional neural networks (DCNN) have made great progress in this task. However, the conventional DCNN-based deraining methods have struggled to exploit deeper and more complex network architectures for pursuing better performance. This study proposes a novel MCGKT-Net for boosting deraining performance, which is a naturally multi-scale learning framework being capable of exploring multi-scale attributes of rain streaks and different semantic structures of the clear images. In order to obtain high representative features inside MCGKT-Net, we explore internal knowledge transfer module using ConvLSTM unit for conducting interaction learning between different layers and investigate external knowledge transfer module for leveraging the knowledge already learned in other task domains. Furthermore, to dynamically select useful features in learning procedure, we propose a multi-scale context gating module in the MCGKT-Net using squeeze-and-excitation block. Experiments on three benchmark datasets: Rain100H, Rain100L, and Rain800, manifest impressive performance compared with state-of-the-art methods.

READ FULL TEXT

page 6

page 10

page 12

page 13

page 14

research
02/24/2021

Efficient and Accurate Multi-scale Topological Network for Single Image Dehazing

Single image dehazing is a challenging ill-posed problem that has drawn ...
research
06/11/2019

FAMED-Net: A Fast and Accurate Multi-scale End-to-end Dehazing Network

Single image dehazing is a critical image pre-processing step for subseq...
research
08/28/2019

A Coarse-to-Fine Multi-stream Hybrid Deraining Network for Single Image Deraining

Single image deraining task is still a very challenging task due to its ...
research
03/25/2021

GridDehazeNet+: An Enhanced Multi-Scale Network with Intra-Task Knowledge Transfer for Single Image Dehazing

We propose an enhanced multi-scale network, dubbed GridDehazeNet+, for s...
research
07/13/2020

Implicit Euler ODE Networks for Single-Image Dehazing

Deep convolutional neural networks (CNN) have been applied for image deh...
research
02/14/2022

Online-updated High-order Collaborative Networks for Single Image Deraining

Single image deraining is an important and challenging task for some dow...
research
03/17/2023

Star-Net: Improving Single Image Desnowing Model With More Efficient Connection and Diverse Feature Interaction

Compared to other severe weather image restoration tasks, single image d...

Please sign up or login with your details

Forgot password? Click here to reset