FastSurf: Fast Neural RGB-D Surface Reconstruction using Per-Frame Intrinsic Refinement and TSDF Fusion Prior Learning

03/08/2023
by   Seunghwan Lee, et al.
0

We introduce FastSurf, an accelerated neural radiance field (NeRF) framework that incorporates depth information for 3D reconstruction. A dense feature grid and shallow multi-layer perceptron are used for fast and accurate surface optimization of the entire scene. Our per-frame intrinsic refinement scheme corrects the frame-specific errors that cannot be handled by global optimization. Furthermore, FastSurf utilizes a classical real-time 3D surface reconstruction method, the truncated signed distance field (TSDF) Fusion, as prior knowledge to pretrain the feature grid to accelerate the training. The quantitative and qualitative experiments comparing the performances of FastSurf against prior work indicate that our method is capable of quickly and accurately reconstructing a scene with high-frequency details. We also demonstrate the effectiveness of our per-frame intrinsic refinement and TSDF Fusion prior learning techniques via an ablation study.

READ FULL TEXT

page 1

page 4

page 6

page 7

research
06/29/2022

GO-Surf: Neural Feature Grid Optimization for Fast, High-Fidelity RGB-D Surface Reconstruction

We present GO-Surf, a direct feature grid optimization method for accura...
research
08/11/2021

Efficient Surfel Fusion Using Normalised Information Distance

We present a new technique that achieves a significant reduction in the ...
research
04/09/2021

Neural RGB-D Surface Reconstruction

In this work, we explore how to leverage the success of implicit novel v...
research
03/22/2023

Uni-Fusion: Universal Continuous Mapping

We introduce Uni-Fusion, an universal continuous mapping framework for s...
research
03/13/2023

A Surface-normal Based Neural Framework for Colonoscopy Reconstruction

Reconstructing a 3D surface from colonoscopy video is challenging due to...
research
03/16/2023

Cross-Dimensional Refined Learning for Real-Time 3D Visual Perception from Monocular Video

We present a novel real-time capable learning method that jointly percei...
research
06/06/2022

Spatial Acoustic Projection for 3D Imaging Sonar Reconstruction

In this work we present a novel method for reconstructing 3D surfaces us...

Please sign up or login with your details

Forgot password? Click here to reset