Physical Model Guided Deep Image Deraining

03/30/2020
by   Honghe Zhu, et al.
Dalian University of Technology
4

Single image deraining is an urgent task because the degraded rainy image makes many computer vision systems fail to work, such as video surveillance and autonomous driving. So, deraining becomes important and an effective deraining algorithm is needed. In this paper, we propose a novel network based on physical model guided learning for single image deraining, which consists of three sub-networks: rain streaks network, rain-free network, and guide-learning network. The concatenation of rain streaks and rain-free image that are estimated by rain streaks network, rain-free network, respectively, is input to the guide-learning network to guide further learning and the direct sum of the two estimated images is constrained with the input rainy image based on the physical model of rainy image. Moreover, we further develop the Multi-Scale Residual Block (MSRB) to better utilize multi-scale information and it is proved to boost the deraining performance. Quantitative and qualitative experimental results demonstrate that the proposed method outperforms the state-of-the-art deraining methods. The source code will be available at <https://supercong94.wixsite.com/supercong94>.

READ FULL TEXT

page 2

page 4

page 5

08/03/2020

DCSFN: Deep Cross-scale Fusion Network for Single Image Rain Removal

Rain removal is an important but challenging computer vision task as rai...
08/16/2022

Rain Removal from Light Field Images with 4D Convolution and Multi-scale Gaussian Process

Existing deraining methods mainly focus on a single input image. With ju...
11/27/2022

Estimating Reflectance Layer from A Single Image: Integrating Reflectance Guidance and Shadow/Specular Aware Learning

Estimating reflectance layer from a single image is a challenging task. ...
03/26/2021

Towards a Unified Approach to Single Image Deraining and Dehazing

We develop a new physical model for the rain effect and show that the we...
11/05/2021

Single Image Deraining Network with Rain Embedding Consistency and Layered LSTM

Single image deraining is typically addressed as residual learning to pr...
02/14/2022

Online-updated High-order Collaborative Networks for Single Image Deraining

Single image deraining is an important and challenging task for some dow...
11/10/2021

Multi-Scale Single Image Dehazing Using Laplacian and Gaussian Pyramids

Model driven single image dehazing was widely studied on top of differen...

Please sign up or login with your details

Forgot password? Click here to reset