Relationship Quantification of Image Degradations

12/08/2022
by   Wenxin Wang, et al.
0

In this paper, we study two challenging but less-touched problems in image restoration, namely, i) how to quantify the relationship between different image degradations and ii) how to improve the performance of a specific restoration task using the quantified relationship. To tackle the first challenge, Degradation Relationship Index (DRI) is proposed to measure the degradation relationship, which is defined as the drop rate difference in the validation loss between two models, i.e., one is trained using the anchor task only and another is trained using the anchor and the auxiliary tasks. Through quantifying the relationship between different degradations using DRI, we empirically observe that i) the degradation combination proportion is crucial to the image restoration performance. In other words, the combinations with only appropriate degradation proportions could improve the performance of the anchor restoration; ii) a positive DRI always predicts the performance improvement of image restoration. Based on the observations, we propose an adaptive Degradation Proportion Determination strategy (DPD) which could improve the performance of the anchor restoration task by using another restoration task as auxiliary. Extensive experimental results verify the effective of our method by taking image dehazing as the anchor task and denoising, desnowing, and deraining as the auxiliary tasks. The code will be released after acceptance.

READ FULL TEXT

page 6

page 7

research
06/23/2023

ProRes: Exploring Degradation-aware Visual Prompt for Universal Image Restoration

Image restoration aims to reconstruct degraded images, e.g., denoising o...
research
04/19/2019

Deep Likelihood Network for Image Restoration with Multiple Degradations

Convolutional neural networks have been proven very effective in a varie...
research
01/01/2022

Image Restoration using Feature-guidance

Image restoration is the task of recovering a clean image from a degrade...
research
01/23/2021

Learning degraded image classification with restoration data fidelity

Learning-based methods especially with convolutional neural networks (CN...
research
08/01/2023

Decomposition Ascribed Synergistic Learning for Unified Image Restoration

Learning to restore multiple image degradations within a single model is...
research
04/01/2020

Work in Progress: Temporally Extended Auxiliary Tasks

Predictive auxiliary tasks have been shown to improve performance in num...
research
01/23/2014

Image Block Loss Restoration Using Sparsity Pattern as Side Information

In this paper, we propose a method for image block loss restoration base...

Please sign up or login with your details

Forgot password? Click here to reset