ExtremeNeRF: Few-shot Neural Radiance Fields Under Unconstrained Illumination

03/21/2023
by   SeokYeong Lee, et al.
0

In this paper, we propose a new challenge that synthesizes a novel view in a more practical environment, where the number of input multi-view images is limited and illumination variations are significant. Despite recent success, neural radiance fields (NeRF) require a massive amount of input multi-view images taken under constrained illuminations. To address the problem, we suggest ExtremeNeRF, which utilizes occlusion-aware multiview albedo consistency, supported by geometric alignment and depth consistency. We extract intrinsic image components that should be illumination-invariant across different views, enabling direct appearance comparison between the input and novel view under unconstrained illumination. We provide extensive experimental results for an evaluation of the task, using the newly built NeRF Extreme benchmark, which is the first in-the-wild novel view synthesis benchmark taken under multiple viewing directions and varying illuminations. The project page is at https://seokyeong94.github.io/ExtremeNeRF/

READ FULL TEXT

page 1

page 7

page 10

page 12

page 16

page 17

page 18

page 19

research
07/24/2020

Self-Supervised Monocular 3D Face Reconstruction by Occlusion-Aware Multi-view Geometry Consistency

Recent learning-based approaches, in which models are trained by single-...
research
05/31/2022

SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collections

Inverse rendering of an object under entirely unknown capture conditions...
research
01/26/2023

GeCoNeRF: Few-shot Neural Radiance Fields via Geometric Consistency

We present a novel framework to regularize Neural Radiance Field (NeRF) ...
research
12/07/2020

NeRD: Neural Reflectance Decomposition from Image Collections

Decomposing a scene into its shape, reflectance, and illumination is a c...
research
11/30/2021

Hallucinated Neural Radiance Fields in the Wild

Neural Radiance Fields (NeRF) has recently gained popularity for its imp...
research
05/18/2023

ConsistentNeRF: Enhancing Neural Radiance Fields with 3D Consistency for Sparse View Synthesis

Neural Radiance Fields (NeRF) has demonstrated remarkable 3D reconstruct...
research
09/25/2017

Variational Reflectance Estimation from Multi-view Images

We tackle the problem of reflectance estimation from a set of multi-view...

Please sign up or login with your details

Forgot password? Click here to reset