Efficient Online Surface Correction for Real-time Large-Scale 3D Reconstruction

by   Robert Maier, et al.

State-of-the-art methods for large-scale 3D reconstruction from RGB-D sensors usually reduce drift in camera tracking by globally optimizing the estimated camera poses in real-time without simultaneously updating the reconstructed surface on pose changes. We propose an efficient on-the-fly surface correction method for globally consistent dense 3D reconstruction of large-scale scenes. Our approach uses a dense Visual RGB-D SLAM system that estimates the camera motion in real-time on a CPU and refines it in a global pose graph optimization. Consecutive RGB-D frames are locally fused into keyframes, which are incorporated into a sparse voxel hashed Signed Distance Field (SDF) on the GPU. On pose graph updates, the SDF volume is corrected on-the-fly using a novel keyframe re-integration strategy with reduced GPU-host streaming. We demonstrate in an extensive quantitative evaluation that our method is up to 93 significantly less memory, with only negligible loss of surface quality. Overall, our system requires only a single GPU and allows for real-time surface correction of large environments.



There are no comments yet.


page 2

page 4

page 5

page 9

page 10


BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integration

Real-time, high-quality, 3D scanning of large-scale scenes is key to mix...

HRBF-Fusion: Accurate 3D reconstruction from RGB-D data using on-the-fly implicits

Reconstruction of high-fidelity 3D objects or scenes is a fundamental re...

InfiniTAM v3: A Framework for Large-Scale 3D Reconstruction with Loop Closure

Volumetric models have become a popular representation for 3D scenes in ...

Collaborative Large-Scale Dense 3D Reconstruction with Online Inter-Agent Pose Optimisation

Reconstructing dense, volumetric models of real-world 3D scenes is impor...

A Framework for the Volumetric Integration of Depth Images

Volumetric models have become a popular representation for 3D scenes in ...

SUNet: Symmetric Undistortion Network for Rolling Shutter Correction

The vast majority of modern consumer-grade cameras employ a rolling shut...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.