Probabilistic Volumetric Fusion for Dense Monocular SLAM

10/03/2022
by   Antoni Rosinol, et al.
23

We present a novel method to reconstruct 3D scenes from images by leveraging deep dense monocular SLAM and fast uncertainty propagation. The proposed approach is able to 3D reconstruct scenes densely, accurately, and in real-time while being robust to extremely noisy depth estimates coming from dense monocular SLAM. Differently from previous approaches, that either use ad-hoc depth filters, or that estimate the depth uncertainty from RGB-D cameras' sensor models, our probabilistic depth uncertainty derives directly from the information matrix of the underlying bundle adjustment problem in SLAM. We show that the resulting depth uncertainty provides an excellent signal to weight the depth-maps for volumetric fusion. Without our depth uncertainty, the resulting mesh is noisy and with artifacts, while our approach generates an accurate 3D mesh with significantly fewer artifacts. We provide results on the challenging Euroc dataset, and show that our approach achieves 92 directly fusing depths from monocular SLAM, and up to 90 to the best competing approach.

READ FULL TEXT

page 2

page 5

page 6

page 7

page 8

research
10/24/2022

NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fields

We propose a novel geometric and photometric 3D mapping pipeline for acc...
research
06/05/2020

MRFMap: Online Probabilistic 3D Mapping using Forward Ray Sensor Models

Traditional dense volumetric representations for robotic mapping make si...
research
06/29/2019

SLAM Endoscopy enhanced by adversarial depth prediction

Medical endoscopy remains a challenging application for simultaneous loc...
research
01/14/2020

DeepFactors: Real-Time Probabilistic Dense Monocular SLAM

The ability to estimate rich geometry and camera motion from monocular i...
research
09/08/2023

Depth Completion with Multiple Balanced Bases and Confidence for Dense Monocular SLAM

Dense SLAM based on monocular cameras does indeed have immense applicati...
research
08/06/2021

Smooth Mesh Estimation from Depth Data using Non-Smooth Convex Optimization

Meshes are commonly used as 3D maps since they encode the topology of th...
research
04/19/2022

Photometric single-view dense 3D reconstruction in endoscopy

Visual SLAM inside the human body will open the way to computer-assisted...

Please sign up or login with your details

Forgot password? Click here to reset