HashSDF: Accurate Implicit Surfaces with Fast Local Features on Permutohedral Lattices

11/22/2022
by   Radu Alexandru Rosu, et al.
0

Neural radiance-density field methods have become increasingly popular for the task of novel-view rendering. Their recent extension to hash-based positional encoding ensures fast training and inference with state-of-the-art results. However, density-based methods struggle with recovering accurate surface geometry. Hybrid methods alleviate this issue by optimizing the density based on an underlying SDF. However, current SDF methods are overly smooth and miss fine geometric details. In this work, we combine the strengths of these two lines of work in a novel hash-based implicit surface representation. We propose improvements to the two areas by replacing the voxel hash encoding with a permutohedral lattice which optimizes faster in three and higher dimensions. We additionally propose a regularization scheme which is crucial for recovering high-frequency geometric detail. We evaluate our method on multiple datasets and show that we can recover geometric detail at the level of pores and wrinkles while using only RGB images for supervision. Furthermore, using sphere tracing we can render novel views at 30 fps on an RTX 3090.

READ FULL TEXT

page 1

page 6

page 7

page 8

research
05/29/2023

FastMESH: Fast Surface Reconstruction by Hexagonal Mesh-based Neural Rendering

Despite the promising results of multi-view reconstruction, the recent n...
research
02/14/2023

HR-NeuS: Recovering High-Frequency Surface Geometry via Neural Implicit Surfaces

Recent advances in neural implicit surfaces for multi-view 3D reconstruc...
research
06/05/2023

Neuralangelo: High-Fidelity Neural Surface Reconstruction

Neural surface reconstruction has been shown to be powerful for recoveri...
research
02/03/2023

Robust Camera Pose Refinement for Multi-Resolution Hash Encoding

Multi-resolution hash encoding has recently been proposed to reduce the ...
research
12/11/2020

Iso-Points: Optimizing Neural Implicit Surfaces with Hybrid Representations

Neural implicit functions have emerged as a powerful representation for ...
research
06/29/2022

GO-Surf: Neural Feature Grid Optimization for Fast, High-Fidelity RGB-D Surface Reconstruction

We present GO-Surf, a direct feature grid optimization method for accura...
research
01/22/2022

MIP-plicits: Level of Detail Factorization of Neural Implicits Sphere Tracing

We introduce MIP-plicits, a novel approach for rendering 3D and 4D Neura...

Please sign up or login with your details

Forgot password? Click here to reset