Conditional Variational Image Deraining

04/23/2020
by   Ying-Jun Du, et al.
5

Image deraining is an important yet challenging image processing task. Though deterministic image deraining methods are developed with encouraging performance, they are infeasible to learn flexible representations for probabilistic inference and diverse predictions. Besides, rain intensity varies both in spatial locations and across color channels, making this task more difficult. In this paper, we propose a Conditional Variational Image Deraining (CVID) network for better deraining performance, leveraging the exclusive generative ability of Conditional Variational Auto-Encoder (CVAE) on providing diverse predictions for the rainy image. To perform spatially adaptive deraining, we propose a spatial density estimation (SDE) module to estimate a rain density map for each image. Since rain density varies across different color channels, we also propose a channel-wise (CW) deraining scheme. Experiments on synthesized and real-world datasets show that the proposed CVID network achieves much better performance than previous deterministic methods on image deraining. Extensive ablation studies validate the effectiveness of the proposed SDE module and CW scheme in our CVID network. The code is available at <https://github.com/Yingjun-Du/VID>.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 7

page 8

page 9

page 10

research
10/30/2020

Exploring Dynamic Context for Multi-path Trajectory Prediction

To accurately predict future positions of different agents in traffic sc...
research
08/02/2023

ADS-Cap: A Framework for Accurate and Diverse Stylized Captioning with Unpaired Stylistic Corpora

Generating visually grounded image captions with specific linguistic sty...
research
07/12/2022

Learning Diverse Tone Styles for Image Retouching

Image retouching, aiming to regenerate the visually pleasing renditions ...
research
07/15/2019

Improving the Harmony of the Composite Image by Spatial-Separated Attention Module

Image composition is one of the most important applications in image pro...
research
10/30/2022

Transposed Variational Auto-encoder with Intrinsic Feature Learning for Traffic Forecasting

In this technical report, we present our solutions to the Traffic4cast 2...
research
08/05/2023

Deep Image Harmonization in Dual Color Spaces

Image harmonization is an essential step in image composition that adjus...
research
09/17/2017

Multi-Entity Dependence Learning with Rich Context via Conditional Variational Auto-encoder

Multi-Entity Dependence Learning (MEDL) explores conditional correlation...

Please sign up or login with your details

Forgot password? Click here to reset