LRT: An Efficient Low-Light Restoration Transformer for Dark Light Field Images

09/06/2022
by   Shansi Zhang, et al.
0

Light field (LF) images with the multi-view property have many applications, which can be severely affected by the low-light imaging. Recent learning-based methods for low-light enhancement have their own disadvantages, such as no noise suppression, complex training process and poor performance in extremely low-light conditions. Targeted on solving these deficiencies while fully utilizing the multi-view information, we propose an efficient Low-light Restoration Transformer (LRT) for LF images, with multiple heads to perform specific intermediate tasks, including denoising, luminance adjustment, refinement and detail enhancement, within a single network, achieving progressive restoration from small scale to full scale. We design an angular transformer block with a view-token scheme to model the global angular relationship efficiently, and a multi-scale window-based transformer block to encode the multi-scale local and global spatial information. To solve the problem of insufficient training data, we formulate a synthesis pipeline by simulating the major noise with the estimated noise parameters of LF camera. Experimental results demonstrate that our method can achieve superior performance on the restoration of extremely low-light and noisy LF images with high efficiency.

READ FULL TEXT

page 1

page 3

page 7

page 8

page 9

page 10

page 12

research
06/03/2023

Unsupervised Low Light Image Enhancement Using SNR-Aware Swin Transformer

Image captured under low-light conditions presents unpleasing artifacts,...
research
11/26/2019

Progressive Retinex: Mutually Reinforced Illumination-Noise Perception Network for Low Light Image Enhancement

Contrast enhancement and noise removal are coupled problems for low-ligh...
research
10/29/2021

An Effective Image Restorer: Denoising and Luminance Adjustment for Low-photon-count Imaging

Imaging under photon-scarce situations introduces challenges to many app...
research
03/05/2020

Harnessing Multi-View Perspective of Light Fields for Low-Light Imaging

Light Field (LF) offers unique advantages such as post-capture refocusin...
research
05/19/2023

RAMiT: Reciprocal Attention Mixing Transformer for Lightweight Image Restoration

Although many recent works have made advancements in the image restorati...
research
07/16/2022

Structural Prior Guided Generative Adversarial Transformers for Low-Light Image Enhancement

We propose an effective Structural Prior guided Generative Adversarial T...
research
04/28/2023

Making the Invisible Visible: Toward High-Quality Terahertz Tomographic Imaging via Physics-Guided Restoration

Terahertz (THz) tomographic imaging has recently attracted significant a...

Please sign up or login with your details

Forgot password? Click here to reset