Multi-View Photometric Stereo Revisited

10/14/2022
by   Berk Kaya, et al.
0

Multi-view photometric stereo (MVPS) is a preferred method for detailed and precise 3D acquisition of an object from images. Although popular methods for MVPS can provide outstanding results, they are often complex to execute and limited to isotropic material objects. To address such limitations, we present a simple, practical approach to MVPS, which works well for isotropic as well as other object material types such as anisotropic and glossy. The proposed approach in this paper exploits the benefit of uncertainty modeling in a deep neural network for a reliable fusion of photometric stereo (PS) and multi-view stereo (MVS) network predictions. Yet, contrary to the recently proposed state-of-the-art, we introduce neural volume rendering methodology for a trustworthy fusion of MVS and PS measurements. The advantage of introducing neural volume rendering is that it helps in the reliable modeling of objects with diverse material types, where existing MVS methods, PS methods, or both may fail. Furthermore, it allows us to work on neural 3D shape representation, which has recently shown outstanding results for many geometric processing tasks. Our suggested new loss function aims to fits the zero level set of the implicit neural function using the most certain MVS and PS network predictions coupled with weighted neural volume rendering cost. The proposed approach shows state-of-the-art results when tested extensively on several benchmark datasets.

READ FULL TEXT

page 3

page 5

page 6

page 8

research
10/11/2021

Neural Radiance Fields Approach to Deep Multi-View Photometric Stereo

We present a modern solution to the multi-view photometric stereo proble...
research
07/17/2020

Polarimetric Multi-View Inverse Rendering

A polarization camera has great potential for 3D reconstruction since th...
research
02/26/2022

Uncertainty-Aware Deep Multi-View Photometric Stereo

This paper presents a simple and effective solution to the problem of mu...
research
06/16/2023

C2F2NeUS: Cascade Cost Frustum Fusion for High Fidelity and Generalizable Neural Surface Reconstruction

There is an emerging effort to combine the two popular technical paths, ...
research
03/27/2023

Adjoint-based Determination of Weaknesses in Structures

An adjoint-based procedure to determine weaknesses, or, more generally t...
research
03/27/2023

NeUDF: Learning Unsigned Distance Fields from Multi-view Images for Reconstructing Non-watertight Models

Volume rendering-based 3D reconstruction from multi-view images has gain...
research
05/09/2021

Beyond Monocular Deraining: Parallel Stereo Deraining Network Via Semantic Prior

Rain is a common natural phenomenon. Taking images in the rain however o...

Please sign up or login with your details

Forgot password? Click here to reset