Decomposition Ascribed Synergistic Learning for Unified Image Restoration

08/01/2023
by   Jinghao Zhang, et al.
0

Learning to restore multiple image degradations within a single model is quite beneficial for real-world applications. Nevertheless, existing works typically concentrate on regarding each degradation independently, while their relationship has been less exploited to ensure the synergistic learning. To this end, we revisit the diverse degradations through the lens of singular value decomposition, with the observation that the decomposed singular vectors and singular values naturally undertake the different types of degradation information, dividing various restoration tasks into two groups,, singular vector dominated and singular value dominated. The above analysis renders a more unified perspective to ascribe the diverse degradations, compared to previous task-level independent learning. The dedicated optimization of degraded singular vectors and singular values inherently utilizes the potential relationship among diverse restoration tasks, attributing to the Decomposition Ascribed Synergistic Learning (DASL). Specifically, DASL comprises two effective operators, namely, Singular VEctor Operator (SVEO) and Singular VAlue Operator (SVAO), to favor the decomposed optimization, which can be lightly integrated into existing convolutional image restoration backbone. Moreover, the congruous decomposition loss has been devised for auxiliary. Extensive experiments on blended five image restoration tasks demonstrate the effectiveness of our method, including image deraining, image dehazing, image denoising, image deblurring, and low-light image enhancement.

READ FULL TEXT

page 1

page 2

page 7

page 8

page 9

page 10

research
06/03/2020

Variational Quantum Singular Value Decomposition

Singular value decomposition is central to many problems in both enginee...
research
01/24/2020

Electric Field Propagation Through Singular Value Decomposition

We demonstrate that the singular value decomposition algorithm in conjun...
research
05/30/2017

A general theory of singular values with applications to signal denoising

We study the Pareto frontier for two competing norms ·_X and ·_Y on a ve...
research
09/18/2022

RankFeat: Rank-1 Feature Removal for Out-of-distribution Detection

The task of out-of-distribution (OOD) detection is crucial for deploying...
research
01/19/2021

Hyperspectral Image Restoration via Multi-mode and Double-weighted Tensor Nuclear Norm Minimization

Tensor nuclear norm (TNN) induced by tensor singular value decomposition...
research
12/08/2022

Relationship Quantification of Image Degradations

In this paper, we study two challenging but less-touched problems in ima...
research
09/27/2022

Efficient Noise Filtration of Images by Low-Rank Singular Vector Approximations of Geodesics' Gramian Matrix

Modern society is interested in capturing high-resolution and fine-quali...

Please sign up or login with your details

Forgot password? Click here to reset