Aleth-NeRF: Low-light Condition View Synthesis with Concealing Fields

03/10/2023
by   Ziteng Cui, et al.
2

Common capture low-light scenes are challenging for most computer vision techniques, including Neural Radiance Fields (NeRF). Vanilla NeRF is viewer-centred that simplifies the rendering process only as light emission from 3D locations in the viewing direction, thus failing to model the low-illumination induced darkness. Inspired by emission theory of ancient Greek that visual perception is accomplished by rays casting from eyes, we make slight modifications on vanilla NeRF to train on multiple views of low-light scene, we can thus render out the well-lit scene in an unsupervised manner. We introduce a surrogate concept, Concealing Fields, that reduce the transport of light during the volume rendering stage. Specifically, our proposed method, Aleth-NeRF, directly learns from the dark image to understand volumetric object representation and concealing field under priors. By simply eliminating Concealing Fields, we can render a single or multi-view well-lit image(s) and gain superior performance over other 2D low light enhancement methods. Additionally, we collect the first paired LOw-light and normal-light Multi-view (LOM) datasets for future research.

READ FULL TEXT

page 1

page 2

page 4

page 6

page 7

page 8

research
07/10/2022

Progressively-connected Light Field Network for Efficient View Synthesis

This paper presents a Progressively-connected Light Field network (ProLi...
research
03/05/2020

Harnessing Multi-View Perspective of Light Fields for Low-Light Imaging

Light Field (LF) offers unique advantages such as post-capture refocusin...
research
04/20/2021

Shadow Neural Radiance Fields for Multi-view Satellite Photogrammetry

We present a new generic method for shadow-aware multi-view satellite ph...
research
06/21/2023

Neural Spectro-polarimetric Fields

Modeling the spatial radiance distribution of light rays in a scene has ...
research
12/15/2022

Relightable Neural Human Assets from Multi-view Gradient Illuminations

Human modeling and relighting are two fundamental problems in computer v...
research
04/20/2022

SILVR: A Synthetic Immersive Large-Volume Plenoptic Dataset

In six-degrees-of-freedom light-field (LF) experiences, the viewer's fre...
research
12/30/2022

SE(3)-Equivariant Reconstruction from Light Field

Recent progress in geometric computer vision has shown significant advan...

Please sign up or login with your details

Forgot password? Click here to reset