Bilevel Generative Learning for Low-Light Vision

08/07/2023
by   Yingchi Liu, et al.
0

Recently, there has been a growing interest in constructing deep learning schemes for Low-Light Vision (LLV). Existing techniques primarily focus on designing task-specific and data-dependent vision models on the standard RGB domain, which inherently contain latent data associations. In this study, we propose a generic low-light vision solution by introducing a generative block to convert data from the RAW to the RGB domain. This novel approach connects diverse vision problems by explicitly depicting data generation, which is the first in the field. To precisely characterize the latent correspondence between the generative procedure and the vision task, we establish a bilevel model with the parameters of the generative block defined as the upper level and the parameters of the vision task defined as the lower level. We further develop two types of learning strategies targeting different goals, namely low cost and high accuracy, to acquire a new bilevel generative learning paradigm. The generative blocks embrace a strong generalization ability in other low-light vision tasks through the bilevel optimization on enhancement tasks. Extensive experimental evaluations on three representative low-light vision tasks, namely enhancement, detection, and segmentation, fully demonstrate the superiority of our proposed approach. The code will be available at https://github.com/Yingchi1998/BGL.

READ FULL TEXT

page 1

page 6

page 7

page 8

research
06/02/2023

Bilevel Fast Scene Adaptation for Low-Light Image Enhancement

Enhancing images in low-light scenes is a challenging but widely concern...
research
10/11/2021

SurroundNet: Towards Effective Low-Light Image Enhancement

Although Convolution Neural Networks (CNNs) has made substantial progres...
research
07/23/2023

ComPtr: Towards Diverse Bi-source Dense Prediction Tasks via A Simple yet General Complementary Transformer

Deep learning (DL) has advanced the field of dense prediction, while gra...
research
10/07/2022

Self-Aligned Concave Curve: Illumination Enhancement for Unsupervised Adaptation

Low light conditions not only degrade human visual experience, but also ...
research
03/21/2023

Visibility Constrained Wide-band Illumination Spectrum Design for Seeing-in-the-Dark

Seeing-in-the-dark is one of the most important and challenging computer...
research
04/21/2022

Toward Fast, Flexible, and Robust Low-Light Image Enhancement

Existing low-light image enhancement techniques are mostly not only diff...
research
02/08/2022

Uncertainty Modeling for Out-of-Distribution Generalization

Though remarkable progress has been achieved in various vision tasks, de...

Please sign up or login with your details

Forgot password? Click here to reset