Multi-View Reconstruction using Signed Ray Distance Functions (SRDF)

08/31/2022
by   Pierre Zins, et al.
0

In this paper, we address the problem of multi-view 3D shape reconstruction. While recent differentiable rendering approaches associated to implicit shape representations have provided breakthrough performance, they are still computationally heavy and often lack precision on the estimated geometries. To overcome these limitations we investigate a new computational approach that builds on a novel shape representation that is volumetric, as in recent differentiable rendering approaches, but parameterized with depth maps to better materialize the shape surface. The shape energy associated to this representation evaluates 3D geometry given color images and does not need appearance prediction but still benefits from volumetric integration when optimized. In practice we propose an implicit shape representation, the SRDF, based on signed distances which we parameterize by depths along camera rays. The associated shape energy considers the agreement between depth prediction consistency and photometric consistency, this at 3D locations within the volumetric representation. Various photo-consistency priors can be accounted for such as a median based baseline, or a more elaborated criterion as with a learned function. The approach retains pixel-accuracy with depth maps and is parallelizable. Our experiments over standard datasets shows that it provides state-of-the-art results with respect to recent approaches with implicit shape representations as well as with respect to traditional multi-view stereo methods.

READ FULL TEXT

page 1

page 7

page 8

research
03/29/2023

Multi-View Azimuth Stereo via Tangent Space Consistency

We present a method for 3D reconstruction only using calibrated multi-vi...
research
12/16/2019

Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervision

Learning-based 3D reconstruction methods have shown impressive results. ...
research
12/13/2021

HVH: Learning a Hybrid Neural Volumetric Representation for Dynamic Hair Performance Capture

Capturing and rendering life-like hair is particularly challenging due t...
research
03/30/2022

HDSDF: Hybrid Directional and Signed Distance Functions for Fast Inverse Rendering

Implicit neural representations of 3D shapes form strong priors that are...
research
03/29/2022

DRaCoN – Differentiable Rasterization Conditioned Neural Radiance Fields for Articulated Avatars

Acquisition and creation of digital human avatars is an important proble...
research
06/30/2023

MARF: The Medial Atom Ray Field Object Representation

We propose Medial Atom Ray Fields (MARFs), a novel neural object represe...
research
05/25/2022

Efficient Textured Mesh Recovery from Multiple Views with Differentiable Rendering

Despite of the promising results on shape and color recovery using self-...

Please sign up or login with your details

Forgot password? Click here to reset