Harnessing Multi-View Perspective of Light Fields for Low-Light Imaging

03/05/2020
by   Mohit Lamba, et al.
11

Light Field (LF) offers unique advantages such as post-capture refocusing and depth estimation, but low-light conditions limit these capabilities. To restore low-light LFs we should harness the geometric cues present in different LF views, which is not possible using single-frame low-light enhancement techniques. We, therefore, propose a deep neural network for Low-Light Light Field (L3F) restoration, which we refer to as L3Fnet. The proposed L3Fnet not only performs the necessary visual enhancement of each LF view but also preserves the epipolar geometry across views. We achieve this by adopting a two-stage architecture for L3Fnet. Stage-I looks at all the LF views to encode the LF geometry. This encoded information is then used in Stage-II to reconstruct each LF view. To facilitate learning-based techniques for low-light LF imaging, we collected a comprehensive LF dataset of various scenes. For each scene, we captured four LFs, one with near-optimal exposure and ISO settings and the others at different levels of low-light conditions varying from low to extreme low-light settings. The effectiveness of the proposed L3Fnet is supported by both visual and numerical comparisons on this dataset. To further analyze the performance of low-light reconstruction methods, we also propose an L3F-wild dataset that contains LF captured late at night with almost zero lux values. No ground truth is available in this dataset. To perform well on the L3F-wild dataset, any method must adapt to the light level of the captured scene. To do this we propose a novel pre-processing block that makes L3Fnet robust to various degrees of low-light conditions. Lastly, we show that L3Fnet can also be used for low-light enhancement of single-frame images, despite it being engineered for LF data. We do so by converting the single-frame DSLR image into a form suitable to L3Fnet, which we call as pseudo-LF.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 7

page 8

page 9

page 10

research
03/10/2023

Aleth-NeRF: Low-light Condition View Synthesis with Concealing Fields

Common capture low-light scenes are challenging for most computer vision...
research
06/05/2023

Unsupervised network for low-light enhancement

Supervised networks address the task of low-light enhancement using pair...
research
09/06/2022

LRT: An Efficient Low-Light Restoration Transformer for Dark Light Field Images

Light field (LF) images with the multi-view property have many applicati...
research
07/20/2023

Lighting up NeRF via Unsupervised Decomposition and Enhancement

Neural Radiance Field (NeRF) is a promising approach for synthesizing no...
research
04/20/2023

ReLight My NeRF: A Dataset for Novel View Synthesis and Relighting of Real World Objects

In this paper, we focus on the problem of rendering novel views from a N...
research
10/18/2022

Nighttime Dehaze-Enhancement

In this paper, we introduce a new computer vision task called nighttime ...
research
06/21/2023

Neural Spectro-polarimetric Fields

Modeling the spatial radiance distribution of light rays in a scene has ...

Please sign up or login with your details

Forgot password? Click here to reset