Task-Driven Deep Image Enhancement Network for Autonomous Driving in Bad Weather

10/14/2021
by   Younkwan Lee, et al.
0

Visual perception in autonomous driving is a crucial part of a vehicle to navigate safely and sustainably in different traffic conditions. However, in bad weather such as heavy rain and haze, the performance of visual perception is greatly affected by several degrading effects. Recently, deep learning-based perception methods have addressed multiple degrading effects to reflect real-world bad weather cases but have shown limited success due to 1) high computational costs for deployment on mobile devices and 2) poor relevance between image enhancement and visual perception in terms of the model ability. To solve these issues, we propose a task-driven image enhancement network connected to the high-level vision task, which takes in an image corrupted by bad weather as input. Specifically, we introduce a novel low memory network to reduce most of the layer connections of dense blocks for less memory and computational cost while maintaining high performance. We also introduce a new task-driven training strategy to robustly guide the high-level task model suitable for both high-quality restoration of images and highly accurate perception. Experiment results demonstrate that the proposed method improves the performance among lane and 2D object detection, and depth estimation largely under adverse weather in terms of both low memory and accuracy.

READ FULL TEXT

page 1

page 5

page 6

research
03/24/2023

MoWE: Mixture of Weather Experts for Multiple Adverse Weather Removal

Currently, most adverse weather removal tasks are handled independently,...
research
03/10/2018

Driving Scene Perception Network: Real-time Joint Detection, Depth Estimation and Semantic Segmentation

As the demand for enabling high-level autonomous driving has increased i...
research
03/16/2023

Symbolic Perception Risk in Autonomous Driving

We develop a novel framework to assess the risk of misperception in a tr...
research
01/10/2022

Vision in adverse weather: Augmentation using CycleGANs with various object detectors for robust perception in autonomous racing

In an autonomous driving system, perception - identification of features...
research
12/16/2021

Autonomous Driving in Adverse Weather Conditions: A Survey

Automated Driving Systems (ADS) open up a new domain for the automotive ...
research
05/22/2023

Why current rain denoising models fail on CycleGAN created rain images in autonomous driving

One of the main tasks of an autonomous agent in a vehicle is to correctl...
research
04/09/2019

UG^2+ Track 2: A Collective Benchmark Effort for Evaluating and Advancing Image Understanding in Poor Visibility Environments

The UG^2+ challenge in IEEE CVPR 2019 aims to evoke a comprehensive disc...

Please sign up or login with your details

Forgot password? Click here to reset