DeepAI AI Chat
Log In Sign Up

SLLEN: Semantic-aware Low-light Image Enhancement Network

11/21/2022
by   Mingye Ju, et al.
Nanjing University
Nanjing University of Posts and Telecommunications
The University of Sydney
0

How to effectively explore semantic feature is vital for low-light image enhancement (LLE). Existing methods usually utilize the semantic feature that is only drawn from the semantic map produced by high-level semantic segmentation network (SSN). However, if the semantic map is not accurately estimated, it would affect the high-level semantic feature (HSF) extraction, which accordingly interferes with LLE. In this paper, we develop a simple yet effective two-branch semantic-aware LLE network (SLLEN) that neatly integrates the random intermediate embedding feature (IEF) (i.e., the information extracted from the intermediate layer of semantic segmentation network) together with the HSF into a unified framework for better LLE. Specifically, for one branch, we utilize an attention mechanism to integrate HSF into low-level feature. For the other branch, we extract IEF to guide the adjustment of low-level feature using nonlinear transformation manner. Finally, semantic-aware features obtained from two branches are fused and decoded for image enhancement. It is worth mentioning that IEF has some randomness compared to HSF despite their similarity on semantic characteristics, thus its introduction can allow network to learn more possibilities by leveraging the latent relationships between the low-level feature and semantic feature, just like the famous saying "God rolls the dice" in Physics Nobel Prize 2022. Comparisons between the proposed SLLEN and other state-of-the-art techniques demonstrate the superiority of SLLEN with respect to LLE quality over all the comparable alternatives.

READ FULL TEXT

page 3

page 5

page 6

page 7

page 10

page 11

page 12

page 14

07/25/2019

Cross Attention Network for Semantic Segmentation

In this paper, we address the semantic segmentation task with a deep net...
04/05/2020

BiSeNet V2: Bilateral Network with Guided Aggregation for Real-time Semantic Segmentation

The low-level details and high-level semantics are both essential to the...
05/10/2022

STDC-MA Network for Semantic Segmentation

Semantic segmentation is applied extensively in autonomous driving and i...
12/13/2021

Semantically Contrastive Learning for Low-light Image Enhancement

Low-light image enhancement (LLE) remains challenging due to the unfavor...
11/19/2022

Semantic-aware Texture-Structure Feature Collaboration for Underwater Image Enhancement

Underwater image enhancement has become an attractive topic as a signifi...
07/09/2022

SHDM-NET: Heat Map Detail Guidance with Image Matting for Industrial Weld Semantic Segmentation Network

In actual industrial production, the assessment of the steel plate weldi...
05/24/2020

JPAD-SE: High-Level Semantics for Joint Perception-Accuracy-Distortion Enhancement in Image Compression

While humans can effortlessly transform complex visual scenes into simpl...