Restoring Images Captured in Arbitrary Hybrid Adverse Weather Conditions in One Go

05/17/2023
by   Ye-Cong Wan, et al.
0

Adverse conditions typically suffer from stochastic hybrid weather degradations (e.g., rainy and hazy night), while existing image restoration algorithms envisage that weather degradations occur independently, thus may fail to handle real-world complicated scenarios. Besides, supervised training is not feasible due to the lack of comprehensive paired dataset to characterize hybrid conditions. To this end, we have advanced the forementioned limitations with two tactics: framework and data. On the one hand, we present a novel unified framework, dubbed RAHC, to Restore Arbitrary Hybrid adverse weather Conditions in one go, which can comfortably cope with hybrid scenarios with insufficient remaining background constituents and restore arbitrary hybrid conditions with a single trained model flexibly. On the other hand, we establish a new dataset, termed HAC, for learning and benchmarking arbitrary Hybrid Adverse Conditions restoration. HAC contains 31 scenarios composed of an arbitrary combination of five common weather, with a total of  316K adverse-weather/clean pairs. As for fabrication, the training set is automatically generated by a dedicated AdverseGAN with no-frills labor, while the test set is manually modulated by experts for authoritative evaluation. Extensive experiments yield superior results and in particular establish new state-of-the-art results on both HAC and conventional datasets.

READ FULL TEXT

page 8

page 10

page 11

page 12

page 13

page 14

page 15

page 18

research
08/28/2023

MetaWeather: Few-Shot Weather-Degraded Image Restoration via Degradation Pattern Matching

Real-world vision tasks frequently suffer from the appearance of adverse...
research
09/03/2022

TogetherNet: Bridging Image Restoration and Object Detection Together via Dynamic Enhancement Learning

Adverse weather conditions such as haze, rain, and snow often impair the...
research
05/29/2023

GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditions

Image restoration in adverse weather conditions is a difficult task in c...
research
03/17/2022

ART-SS: An Adaptive Rejection Technique for Semi-Supervised restoration for adverse weather-affected images

In recent years, convolutional neural network-based single image adverse...
research
12/15/2021

Image-Adaptive YOLO for Object Detection in Adverse Weather Conditions

Though deep learning-based object detection methods have achieved promis...
research
04/23/2022

Unsupervised Restoration of Weather-affected Images using Deep Gaussian Process-based CycleGAN

Existing approaches for restoring weather-degraded images follow a fully...
research
11/29/2021

TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditions

Removing adverse weather conditions like rain, fog, and snow from images...

Please sign up or login with your details

Forgot password? Click here to reset