INGeo: Accelerating Instant Neural Scene Reconstruction with Noisy Geometry Priors

12/05/2022
by   Chaojian Li, et al.
4

We present a method that accelerates reconstruction of 3D scenes and objects, aiming to enable instant reconstruction on edge devices such as mobile phones and AR/VR headsets. While recent works have accelerated scene reconstruction training to minute/second-level on high-end GPUs, there is still a large gap to the goal of instant training on edge devices which is yet highly desired in many emerging applications such as immersive AR/VR. To this end, this work aims to further accelerate training by leveraging geometry priors of the target scene. Our method proposes strategies to alleviate the noise of the imperfect geometry priors to accelerate the training speed on top of the highly optimized Instant-NGP. On the NeRF Synthetic dataset, our work uses half of the training iterations to reach an average test PSNR of >30.

READ FULL TEXT

page 2

page 5

research
07/21/2023

RICo: Rotate-Inpaint-Complete for Generalizable Scene Reconstruction

General scene reconstruction refers to the task of estimating the full 3...
research
09/27/2016

De-noising, Stabilizing and Completing 3D Reconstructions On-the-go using Plane Priors

Creating 3D maps on robots and other mobile devices has become a reality...
research
09/19/2022

MAGES 4.0: Accelerating the world's transition to medical VR training

In this work, we propose MAGES 4.0, a novel Software Development Kit (SD...
research
06/05/2023

H2-Mapping: Real-time Dense Mapping Using Hierarchical Hybrid Representation

Constructing a high-quality dense map in real-time is essential for robo...
research
04/24/2023

Instant-3D: Instant Neural Radiance Field Training Towards On-Device AR/VR 3D Reconstruction

Neural Radiance Field (NeRF) based 3D reconstruction is highly desirable...
research
03/22/2018

Generalized Scene Reconstruction

A new passive approach called Generalized Scene Reconstruction (GSR) ena...
research
10/17/2022

VoxelCache: Accelerating Online Mapping in Robotics and 3D Reconstruction Tasks

Real-time 3D mapping is a critical component in many important applicati...

Please sign up or login with your details

Forgot password? Click here to reset