An End-to-End Cascaded Image Deraining and Object Detection Neural Network

by   Kaige Wang, et al.

While the deep learning-based image deraining methods have made great progress in recent years, there are two major shortcomings in their application in real-world situations. Firstly, the gap between the low-level vision task represented by rain removal and the high-level vision task represented by object detection is significant, and the low-level vision task can hardly contribute to the high-level vision task. Secondly, the quality of the deraining dataset needs to be improved. In fact, the rain lines in many baselines have a large gap with the real rain lines, and the resolution of the deraining dataset images is generally not ideally. Meanwhile, there are few common datasets for both the low-level vision task and the high-level vision task. In this paper, we explore the combination of the low-level vision task with the high-level vision task. Specifically, we propose an end-to-end object detection network for reducing the impact of rainfall, which consists of two cascaded networks, an improved image deraining network and an object detection network, respectively. We also design the components of the loss function to accommodate the characteristics of the different sub-networks. We then propose a dataset based on the KITTI dataset for rainfall removal and object detection, on which our network surpasses the state-of-the-art with a significant improvement in metrics. Besides, our proposed network is measured on driving videos collected by self-driving vehicles and shows positive results for rain removal and object detection.


page 1

page 3

page 5

page 6


Rethinking Implicit Neural Representations for Vision Learners

Implicit Neural Representations (INRs) are powerful to parameterize cont...

Learning RGB-D Salient Object Detection using background enclosure, depth contrast, and top-down features

Recently, deep Convolutional Neural Networks (CNN) have demonstrated str...

Object Detection with Deep Learning: A Review

Due to object detection's close relationship with video analysis and ima...

RB-Dust – A Reference-based Dataset for Vision-based Dust Removal

Dust in the agricultural landscape is a significant challenge and influe...

DarkVision: A Benchmark for Low-light Image/Video Perception

Imaging and perception in photon-limited scenarios is necessary for vari...

Bridging Gap between Image Pixels and Semantics via Supervision: A Survey

The fact that there exists a gap between low-level features and semantic...

Image coding for machines: an end-to-end learned approach

Over recent years, deep learning-based computer vision systems have been...

Please sign up or login with your details

Forgot password? Click here to reset