Contrastive Learning Based Recursive Dynamic Multi-Scale Network for Image Deraining

05/29/2023
by   Zhiying Jiang, et al.
0

Rain streaks significantly decrease the visibility of captured images and are also a stumbling block that restricts the performance of subsequent computer vision applications. The existing deep learning-based image deraining methods employ manually crafted networks and learn a straightforward projection from rainy images to clear images. In pursuit of better deraining performance, they focus on elaborating a more complicated architecture rather than exploiting the intrinsic properties of the positive and negative information. In this paper, we propose a contrastive learning-based image deraining method that investigates the correlation between rainy and clear images and leverages a contrastive prior to optimize the mutual information of the rainy and restored counterparts. Given the complex and varied real-world rain patterns, we develop a recursive mechanism. It involves multi-scale feature extraction and dynamic cross-level information recruitment modules. The former advances the portrayal of diverse rain patterns more precisely, while the latter can selectively compensate high-level features for shallow-level information. We term the proposed recursive dynamic multi-scale network with a contrastive prior, RDMC. Extensive experiments on synthetic benchmarks and real-world images demonstrate that the proposed RDMC delivers strong performance on the depiction of rain streaks and outperforms the state-of-the-art methods. Moreover, a practical evaluation of object detection and semantic segmentation shows the effectiveness of the proposed method.

READ FULL TEXT

page 2

page 6

page 7

page 8

page 9

page 10

page 11

page 12

research
04/19/2021

Contrastive Learning for Compact Single Image Dehazing

Single image dehazing is a challenging ill-posed problem due to the seve...
research
11/17/2021

SAPNet: Segmentation-Aware Progressive Network for Perceptual Contrastive Deraining

Deep learning algorithms have recently achieved promising deraining perf...
research
12/22/2022

Restoring Vision in Hazy Weather with Hierarchical Contrastive Learning

Image restoration under hazy weather condition, which is called single i...
research
03/15/2022

Unpaired Deep Image Dehazing Using Contrastive Disentanglement Learning

We present an effective unpaired learning based image dehazing network f...
research
03/21/2021

Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priors

Images captured in snowy days suffer from noticeable degradation of scen...
research
06/21/2021

Contrastive Multi-Modal Clustering

Multi-modal clustering, which explores complementary information from mu...
research
09/02/2020

Efficient, high-performance pancreatic segmentation using multi-scale feature extraction

For artificial intelligence-based image analysis methods to reach clinic...

Please sign up or login with your details

Forgot password? Click here to reset