Depth-NeuS: Neural Implicit Surfaces Learning for Multi-view Reconstruction Based on Depth Information Optimization

03/30/2023
by   Hanqi Jiang, et al.
0

Recently, methods for neural surface representation and rendering, for example NeuS, have shown that learning neural implicit surfaces through volume rendering is becoming increasingly popular and making good progress. However, these methods still face some challenges. Existing methods lack a direct representation of depth information, which makes object reconstruction unrestricted by geometric features, resulting in poor reconstruction of objects with texture and color features. This is because existing methods only use surface normals to represent implicit surfaces without using depth information. Therefore, these methods cannot model the detailed surface features of objects well. To address this problem, we propose a neural implicit surface learning method called Depth-NeuS based on depth information optimization for multi-view reconstruction. In this paper, we introduce depth loss to explicitly constrain SDF regression and introduce geometric consistency loss to optimize for low-texture areas. Specific experiments show that Depth-NeuS outperforms existing technologies in multiple scenarios and achieves high-quality surface reconstruction in multiple scenarios.

READ FULL TEXT

page 2

page 3

page 6

research
05/31/2022

Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstruction

Recently, neural implicit surfaces learning by volume rendering has beco...
research
03/16/2023

Learning a Room with the Occ-SDF Hybrid: Signed Distance Function Mingled with Occupancy Aids Scene Representation

Implicit neural rendering, which uses signed distance function (SDF) rep...
research
03/27/2023

TMO: Textured Mesh Acquisition of Objects with a Mobile Device by using Differentiable Rendering

We present a new pipeline for acquiring a textured mesh in the wild with...
research
08/09/2023

A General Implicit Framework for Fast NeRF Composition and Rendering

A variety of Neural Radiance Fields (NeRF) methods have recently achieve...
research
03/20/2023

Ref-NeuS: Ambiguity-Reduced Neural Implicit Surface Learning for Multi-View Reconstruction with Reflection

Neural implicit surface learning has shown significant progress in multi...
research
03/30/2023

S-VolSDF: Sparse Multi-View Stereo Regularization of Neural Implicit Surfaces

Neural rendering of implicit surfaces performs well in 3D vision applica...
research
12/08/2022

Multi-View Mesh Reconstruction with Neural Deferred Shading

We propose an analysis-by-synthesis method for fast multi-view 3D recons...

Please sign up or login with your details

Forgot password? Click here to reset