Empowering Low-Light Image Enhancer through Customized Learnable Priors

09/05/2023
by   Naishan Zheng, et al.
0

Deep neural networks have achieved remarkable progress in enhancing low-light images by improving their brightness and eliminating noise. However, most existing methods construct end-to-end mapping networks heuristically, neglecting the intrinsic prior of image enhancement task and lacking transparency and interpretability. Although some unfolding solutions have been proposed to relieve these issues, they rely on proximal operator networks that deliver ambiguous and implicit priors. In this work, we propose a paradigm for low-light image enhancement that explores the potential of customized learnable priors to improve the transparency of the deep unfolding paradigm. Motivated by the powerful feature representation capability of Masked Autoencoder (MAE), we customize MAE-based illumination and noise priors and redevelop them from two perspectives: 1) structure flow: we train the MAE from a normal-light image to its illumination properties and then embed it into the proximal operator design of the unfolding architecture; and m2) optimization flow: we train MAE from a normal-light image to its gradient representation and then employ it as a regularization term to constrain noise in the model output. These designs improve the interpretability and representation capability of the model.Extensive experiments on multiple low-light image enhancement datasets demonstrate the superiority of our proposed paradigm over state-of-the-art methods. Code is available at https://github.com/zheng980629/CUE.

READ FULL TEXT
research
08/30/2023

Learned Image Reasoning Prior Penetrates Deep Unfolding Network for Panchromatic and Multi-Spectral Image Fusion

The success of deep neural networks for pan-sharpening is commonly in a ...
research
04/14/2023

Learning Semantic-Aware Knowledge Guidance for Low-Light Image Enhancement

Low-light image enhancement (LLIE) investigates how to improve illuminat...
research
10/11/2021

SurroundNet: Towards Effective Low-Light Image Enhancement

Although Convolution Neural Networks (CNNs) has made substantial progres...
research
04/28/2022

Deep Generalized Unfolding Networks for Image Restoration

Deep neural networks (DNN) have achieved great success in image restorat...
research
08/10/2023

Enhancing Low-light Light Field Images with A Deep Compensation Unfolding Network

This paper presents a novel and interpretable end-to-end learning framew...
research
04/21/2022

Toward Fast, Flexible, and Robust Low-Light Image Enhancement

Existing low-light image enhancement techniques are mostly not only diff...
research
05/17/2023

NFI_2: Learning Noise-Free Illuminance-Interpolator for Unsupervised Low-Light Image Enhancement

Low-light situations severely restrict the pursuit of aesthetic quality ...

Please sign up or login with your details

Forgot password? Click here to reset