IBL-NeRF: Image-Based Lighting Formulation of Neural Radiance Fields

10/15/2022
by   Changwoon Choi, et al.
0

We propose IBL-NeRF, which decomposes the neural radiance fields (NeRF) of large-scale indoor scenes into intrinsic components. Previous approaches for the inverse rendering of NeRF transform the implicit volume to fit the rendering pipeline of explicit geometry, and approximate the views of segmented, isolated objects with environment lighting. In contrast, our inverse rendering extends the original NeRF formulation to capture the spatial variation of lighting within the scene volume, in addition to surface properties. Specifically, the scenes of diverse materials are decomposed into intrinsic components for image-based rendering, namely, albedo, roughness, surface normal, irradiance, and prefiltered radiance. All of the components are inferred as neural images from MLP, which can model large-scale general scenes. By adopting the image-based formulation of NeRF, our approach inherits superior visual quality and multi-view consistency for synthesized images. We demonstrate the performance on scenes with complex object layouts and light configurations, which could not be processed in any of the previous works.

READ FULL TEXT

page 6

page 8

page 16

page 17

page 18

page 19

page 20

page 21

research
03/14/2022

NeILF: Neural Incident Light Field for Physically-based Material Estimation

We present a differentiable rendering framework for material and lightin...
research
05/22/2023

NeRFuser: Large-Scale Scene Representation by NeRF Fusion

A practical benefit of implicit visual representations like Neural Radia...
research
04/06/2023

Neural Fields meet Explicit Geometric Representation for Inverse Rendering of Urban Scenes

Reconstruction and intrinsic decomposition of scenes from captured image...
research
11/27/2022

3D Scene Creation and Rendering via Rough Meshes: A Lighting Transfer Avenue

This paper studies how to flexibly integrate reconstructed 3D models int...
research
05/05/2023

Learn how to Prune Pixels for Multi-view Neural Image-based Synthesis

Image-based rendering techniques stand at the core of an immersive exper...
research
12/20/2021

Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughs

We use neural radiance fields (NeRFs) to build interactive 3D environmen...
research
10/08/2020

Cinema Darkroom: A Deferred Rendering Framework for Large-Scale Datasets

This paper presents a framework that fully leverages the advantages of a...

Please sign up or login with your details

Forgot password? Click here to reset