NeRD: Neural Reflectance Decomposition from Image Collections

12/07/2020
by   Mark Boss, et al.
0

Decomposing a scene into its shape, reflectance, and illumination is a challenging but essential problem in computer vision and graphics. This problem is inherently more challenging when the illumination is not a single light source under laboratory conditions but is instead an unconstrained environmental illumination. Though recent work has shown that implicit representations can be used to model the radiance field of an object, these techniques only enable view synthesis and not relighting. Additionally, evaluating these radiance fields is resource and time-intensive. By decomposing a scene into explicit representations, any rendering framework can be leveraged to generate novel views under any illumination in real-time. NeRD is a method that achieves this decomposition by introducing physically-based rendering to neural radiance fields. Even challenging non-Lambertian reflectances, complex geometry, and unknown illumination can be decomposed into high-quality models. The datasets and code is available on the project page: https://markboss.me/publication/2021-nerd/

READ FULL TEXT

page 1

page 6

page 7

page 8

page 10

page 11

page 16

page 17

research
10/27/2021

Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decomposition

Decomposing a scene into its shape, reflectance and illumination is a fu...
research
05/31/2022

SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collections

Inverse rendering of an object under entirely unknown capture conditions...
research
07/27/2022

Neural Radiance Transfer Fields for Relightable Novel-view Synthesis with Global Illumination

Given a set of images of a scene, the re-rendering of this scene from no...
research
11/25/2020

DeRF: Decomposed Radiance Fields

With the advent of Neural Radiance Fields (NeRF), neural networks can no...
research
10/02/2022

IntrinsicNeRF: Learning Intrinsic Neural Radiance Fields for Editable Novel View Synthesis

We present intrinsic neural radiance fields, dubbed IntrinsicNeRF, that ...
research
06/28/2021

Fast Training of Neural Lumigraph Representations using Meta Learning

Novel view synthesis is a long-standing problem in machine learning and ...
research
03/21/2023

ExtremeNeRF: Few-shot Neural Radiance Fields Under Unconstrained Illumination

In this paper, we propose a new challenge that synthesizes a novel view ...

Please sign up or login with your details

Forgot password? Click here to reset