Edge-preserving Near-light Photometric Stereo with Neural Surfaces

07/11/2022
by   Heng Guo, et al.
0

This paper presents a near-light photometric stereo method that faithfully preserves sharp depth edges in the 3D reconstruction. Unlike previous methods that rely on finite differentiation for approximating depth partial derivatives and surface normals, we introduce an analytically differentiable neural surface in near-light photometric stereo for avoiding differentiation errors at sharp depth edges, where the depth is represented as a neural function of the image coordinates. By further formulating the Lambertian albedo as a dependent variable resulting from the surface normal and depth, our method is insusceptible to inaccurate depth initialization. Experiments on both synthetic and real-world scenes demonstrate the effectiveness of our method for detailed shape recovery with edge preservation.

READ FULL TEXT

page 10

page 13

research
11/28/2022

NeuralMPS: Non-Lambertian Multispectral Photometric Stereo via Spectral Reflectance Decomposition

Multispectral photometric stereo(MPS) aims at recovering the surface nor...
research
03/18/2019

Self-calibrating Deep Photometric Stereo Networks

This paper proposes an uncalibrated photometric stereo method for non-La...
research
07/16/2020

Least squares surface reconstruction on arbitrary domains

Almost universally in computer vision, when surface derivatives are requ...
research
05/22/2017

DepthCut: Improved Depth Edge Estimation Using Multiple Unreliable Channels

In the context of scene understanding, a variety of methods exists to es...
research
03/28/2022

DeepShadow: Neural Shape from Shadow

This paper presents DeepShadow, a one-shot method for recovering the dep...
research
06/23/2023

Differentiable Display Photometric Stereo

Photometric stereo leverages variations in illumination conditions to re...
research
03/30/2022

Fast Light-Weight Near-Field Photometric Stereo

We introduce the first end-to-end learning-based solution to near-field ...

Please sign up or login with your details

Forgot password? Click here to reset