Fearless Luminance Adaptation: A Macro-Micro-Hierarchical Transformer for Exposure Correction

09/02/2023
by   Gehui Li, et al.
0

Photographs taken with less-than-ideal exposure settings often display poor visual quality. Since the correction procedures vary significantly, it is difficult for a single neural network to handle all exposure problems. Moreover, the inherent limitations of convolutions, hinder the models ability to restore faithful color or details on extremely over-/under- exposed regions. To overcome these limitations, we propose a Macro-Micro-Hierarchical transformer, which consists of a macro attention to capture long-range dependencies, a micro attention to extract local features, and a hierarchical structure for coarse-to-fine correction. In specific, the complementary macro-micro attention designs enhance locality while allowing global interactions. The hierarchical structure enables the network to correct exposure errors of different scales layer by layer. Furthermore, we propose a contrast constraint and couple it seamlessly in the loss function, where the corrected image is pulled towards the positive sample and pushed away from the dynamically generated negative samples. Thus the remaining color distortion and loss of detail can be removed. We also extend our method as an image enhancer for low-light face recognition and low-light semantic segmentation. Experiments demonstrate that our approach obtains more attractive results than state-of-the-art methods quantitatively and qualitatively.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

page 8

research
09/08/2023

CNN Injected Transformer for Image Exposure Correction

Capturing images with incorrect exposure settings fails to deliver a sat...
research
03/25/2020

Learning to Correct Overexposed and Underexposed Photos

Capturing photographs with wrong exposures remains a major source of err...
research
04/22/2022

Exposure Correction Model to Enhance Image Quality

Exposure errors in an image cause a degradation in the contrast and low ...
research
05/13/2021

Efficient Lightweight 3D-CNN using Frame Skipping and Contrast Enhancement for Facial Macro- and Micro-expression Spotting

Micro-expression spotting is the preliminary step for any micro-expressi...
research
02/16/2022

Learning to Adapt to Light

Light adaptation or brightness correction is a key step in improving the...
research
06/29/2023

A Micro-Macro Parareal Implementation for the Ocean-Circulation Model FESOM2

A micro-macro variant of the parallel-in-time algorithm Parareal has bee...
research
09/03/2023

Holistic Dynamic Frequency Transformer for Image Fusion and Exposure Correction

The correction of exposure-related issues is a pivotal component in enha...

Please sign up or login with your details

Forgot password? Click here to reset