NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAM

02/07/2023
by   Zihan Zhu, et al.
0

Neural implicit representations have recently become popular in simultaneous localization and mapping (SLAM), especially in dense visual SLAM. However, previous works in this direction either rely on RGB-D sensors, or require a separate monocular SLAM approach for camera tracking and do not produce high-fidelity dense 3D scene reconstruction. In this paper, we present NICER-SLAM, a dense RGB SLAM system that simultaneously optimizes for camera poses and a hierarchical neural implicit map representation, which also allows for high-quality novel view synthesis. To facilitate the optimization process for mapping, we integrate additional supervision signals including easy-to-obtain monocular geometric cues and optical flow, and also introduce a simple warping loss to further enforce geometry consistency. Moreover, to further boost performance in complicated indoor scenes, we also propose a local adaptive transformation from signed distance functions (SDFs) to density in the volume rendering equation. On both synthetic and real-world datasets we demonstrate strong performance in dense mapping, tracking, and novel view synthesis, even competitive with recent RGB-D SLAM systems.

READ FULL TEXT

page 1

page 3

page 7

page 8

page 9

research
01/21/2023

Dense RGB SLAM with Neural Implicit Maps

There is an emerging trend of using neural implicit functions for map re...
research
09/05/2023

GO-SLAM: Global Optimization for Consistent 3D Instant Reconstruction

Neural implicit representations have recently demonstrated compelling re...
research
11/21/2022

ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fields

We present ESLAM, an efficient implicit neural representation method for...
research
09/27/2022

Orbeez-SLAM: A Real-time Monocular Visual SLAM with ORB Features and NeRF-realized Mapping

A spatial AI that can perform complex tasks through visual signals and c...
research
06/01/2023

FMapping: Factorized Efficient Neural Field Mapping for Real-Time Dense RGB SLAM

In this paper, we introduce FMapping, an efficient neural field mapping ...
research
08/28/2023

Multi-Modal Neural Radiance Field for Monocular Dense SLAM with a Light-Weight ToF Sensor

Light-weight time-of-flight (ToF) depth sensors are compact and cost-eff...
research
03/23/2021

iMAP: Implicit Mapping and Positioning in Real-Time

We show for the first time that a multilayer perceptron (MLP) can serve ...

Please sign up or login with your details

Forgot password? Click here to reset