Bilevel Fast Scene Adaptation for Low-Light Image Enhancement

06/02/2023
by   Long Ma, et al.
0

Enhancing images in low-light scenes is a challenging but widely concerned task in the computer vision. The mainstream learning-based methods mainly acquire the enhanced model by learning the data distribution from the specific scenes, causing poor adaptability (even failure) when meeting real-world scenarios that have never been encountered before. The main obstacle lies in the modeling conundrum from distribution discrepancy across different scenes. To remedy this, we first explore relationships between diverse low-light scenes based on statistical analysis, i.e., the network parameters of the encoder trained in different data distributions are close. We introduce the bilevel paradigm to model the above latent correspondence from the perspective of hyperparameter optimization. A bilevel learning framework is constructed to endow the scene-irrelevant generality of the encoder towards diverse scenes (i.e., freezing the encoder in the adaptation and testing phases). Further, we define a reinforced bilevel learning framework to provide a meta-initialization for scene-specific decoder to further ameliorate visual quality. Moreover, to improve the practicability, we establish a Retinex-induced architecture with adaptive denoising and apply our built learning framework to acquire its parameters by using two training losses including supervised and unsupervised forms. Extensive experimental evaluations on multiple datasets verify our adaptability and competitive performance against existing state-of-the-art works. The code and datasets will be available at https://github.com/vis-opt-group/BL.

READ FULL TEXT

page 2

page 3

page 9

page 10

page 11

page 12

page 13

page 14

research
04/21/2022

Toward Fast, Flexible, and Robust Low-Light Image Enhancement

Existing low-light image enhancement techniques are mostly not only diff...
research
08/07/2023

Bilevel Generative Learning for Low-Light Vision

Recently, there has been a growing interest in constructing deep learnin...
research
12/09/2021

Learning with Nested Scene Modeling and Cooperative Architecture Search for Low-Light Vision

Images captured from low-light scenes often suffer from severe degradati...
research
10/31/2020

TartanVO: A Generalizable Learning-based VO

We present the first learning-based visual odometry (VO) model, which ge...
research
06/05/2023

Unsupervised network for low-light enhancement

Supervised networks address the task of low-light enhancement using pair...
research
01/02/2023

Task-specific Scene Structure Representations

Understanding the informative structures of scenes is essential for low-...
research
08/20/2020

Meta-Sim2: Unsupervised Learning of Scene Structure for Synthetic Data Generation

Procedural models are being widely used to synthesize scenes for graphic...

Please sign up or login with your details

Forgot password? Click here to reset