Neural apparent BRDF fields for multiview photometric stereo

07/14/2022
by   Meghna Asthana, et al.
0

We propose to tackle the multiview photometric stereo problem using an extension of Neural Radiance Fields (NeRFs), conditioned on light source direction. The geometric part of our neural representation predicts surface normal direction, allowing us to reason about local surface reflectance. The appearance part of our neural representation is decomposed into a neural bidirectional reflectance function (BRDF), learnt as part of the fitting process, and a shadow prediction network (conditioned on light source direction) allowing us to model the apparent BRDF. This balance of learnt components with inductive biases based on physical image formation models allows us to extrapolate far from the light source and viewer directions observed during training. We demonstrate our approach on a multiview photometric stereo benchmark and show that competitive performance can be obtained with the neural density representation of a NeRF.

READ FULL TEXT

page 5

page 7

research
12/12/2020

Uncalibrated Neural Inverse Rendering for Photometric Stereo of General Surfaces

This paper presents an uncalibrated deep neural network framework for th...
research
04/11/2022

An Optimal Experimental Design Approach for Light Configurations in Photometric Stereo

This paper presents a technique for finding the surface normal of an obj...
research
08/30/2018

CNN-PS: CNN-based Photometric Stereo for General Non-Convex Surfaces

Most conventional photometric stereo algorithms inversely solve a BRDF-b...
research
07/21/2023

Ascertaining the ideality of photometric stereo datasets under unknown lighting

The standard photometric stereo model makes several assumptions that are...
research
11/28/2022

NeuralMPS: Non-Lambertian Multispectral Photometric Stereo via Spectral Reflectance Decomposition

Multispectral photometric stereo(MPS) aims at recovering the surface nor...
research
06/14/2020

2D Image Relighting with Image-to-Image Translation

With the advent of Generative Adversarial Networks (GANs), a finer level...
research
10/18/2022

On-the-go Reflectance Transformation Imaging with Ordinary Smartphones

Reflectance Transformation Imaging (RTI) is a popular technique that all...

Please sign up or login with your details

Forgot password? Click here to reset