Unlocking Low-Light-Rainy Image Restoration by Pairwise Degradation Feature Vector Guidance

05/06/2023
by   Xin Lin, et al.
1

Rain in the dark is a common natural phenomenon. Photos captured in such a condition significantly impact the performance of various nighttime activities, such as autonomous driving, surveillance systems, and night photography. While existing methods designed for low-light enhancement or deraining show promising performance, they have limitations in simultaneously addressing the task of brightening low light and removing rain. Furthermore, using a cascade approach, such as “deraining followed by low-light enhancement” or vice versa, may lead to difficult-to-handle rain patterns or excessively blurred and overexposed images. To overcome these limitations, we propose an end-to-end network called L^2RIRNet which can jointly handle low-light enhancement and deraining. Our network mainly includes a Pairwise Degradation Feature Vector Extraction Network (P-Net) and a Restoration Network (R-Net). P-Net can learn degradation feature vectors on the dark and light areas separately, using contrastive learning to guide the image restoration process. The R-Net is responsible for restoring the image. We also introduce an effective Fast Fourier - ResNet Detail Guidance Module (FFR-DG) that initially guides image restoration using detail image that do not contain degradation information but focus on texture detail information. Additionally, we contribute a dataset containing synthetic and real-world low-light-rainy images. Extensive experiments demonstrate that our L^2RIRNet outperforms existing methods in both synthetic and complex real-world scenarios.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 7

page 8

research
06/28/2021

R2RNet: Low-light Image Enhancement via Real-low to Real-normal Network

Images captured in weak illumination conditions will seriously degrade t...
research
08/23/2022

Low-Light Video Enhancement with Synthetic Event Guidance

Low-light video enhancement (LLVE) is an important yet challenging task ...
research
02/07/2022

LEDNet: Joint Low-light Enhancement and Deblurring in the Dark

Night photography typically suffers from both low light and blurring iss...
research
07/27/2023

LLDiffusion: Learning Degradation Representations in Diffusion Models for Low-Light Image Enhancement

Current deep learning methods for low-light image enhancement (LLIE) typ...
research
06/14/2022

Asymmetric Dual-Decoder U-Net for Joint Rain and Haze Removal

This work studies the joint rain and haze removal problem. In real-life ...
research
05/10/2023

Low-Light Image Enhancement via Structure Modeling and Guidance

This paper proposes a new framework for low-light image enhancement by s...
research
01/01/2022

Image Restoration using Feature-guidance

Image restoration is the task of recovering a clean image from a degrade...

Please sign up or login with your details

Forgot password? Click here to reset