EfficientDeRain: Learning Pixel-wise Dilation Filtering for High-Efficiency Single-Image Deraining

09/19/2020
by   Qing Guo, et al.
11

Single-image deraining is rather challenging due to the unknown rain model. Existing methods often make specific assumptions of the rain model, which can hardly cover many diverse circumstances in the real world, making them have to employ complex optimization or progressive refinement. This, however, significantly affects these methods' efficiency and effectiveness for many efficiency-critical applications. To fill this gap, in this paper, we regard the single-image deraining as a general image-enhancing problem and originally propose a model-free deraining method, i.e., EfficientDeRain, which is able to process a rainy image within 10 ms (i.e., around 6 ms on average), over 80 times faster than the state-of-the-art method (i.e., RCDNet), while achieving similar de-rain effects. We first propose the novel pixel-wise dilation filtering. In particular, a rainy image is filtered with the pixel-wise kernels estimated from a kernel prediction network, by which suitable multi-scale kernels for each pixel can be efficiently predicted. Then, to eliminate the gap between synthetic and real data, we further propose an effective data augmentation method (i.e., RainMix) that helps to train network for real rainy image handling.We perform comprehensive evaluation on both synthetic and real-world rainy datasets to demonstrate the effectiveness and efficiency of our method. We release the model and code in https://github.com/tsingqguo/efficientderain.git.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 6

page 7

research
08/12/2020

Guided Collaborative Training for Pixel-wise Semi-Supervised Learning

We investigate the generalization of semi-supervised learning (SSL) to d...
research
07/20/2023

Physics-Driven Turbulence Image Restoration with Stochastic Refinement

Image distortion by atmospheric turbulence is a stochastic degradation, ...
research
09/09/2023

Towards Real-World Burst Image Super-Resolution: Benchmark and Method

Despite substantial advances, single-image super-resolution (SISR) is al...
research
06/09/2022

ECLAD: Extracting Concepts with Local Aggregated Descriptors

Convolutional neural networks are being increasingly used in critical sy...
research
08/06/2021

From Synthetic to Real: Image Dehazing Collaborating with Unlabeled Real Data

Single image dehazing is a challenging task, for which the domain shift ...
research
04/02/2022

PixelFolder: An Efficient Progressive Pixel Synthesis Network for Image Generation

Pixel synthesis is a promising research paradigm for image generation, w...
research
08/14/2023

Probabilistic MIMO U-Net: Efficient and Accurate Uncertainty Estimation for Pixel-wise Regression

Uncertainty estimation in machine learning is paramount for enhancing th...

Please sign up or login with your details

Forgot password? Click here to reset