iMAP: Implicit Mapping and Positioning in Real-Time

03/23/2021
by   Edgar Sucar, et al.
4

We show for the first time that a multilayer perceptron (MLP) can serve as the only scene representation in a real-time SLAM system for a handheld RGB-D camera. Our network is trained in live operation without prior data, building a dense, scene-specific implicit 3D model of occupancy and colour which is also immediately used for tracking. Achieving real-time SLAM via continual training of a neural network against a live image stream requires significant innovation. Our iMAP algorithm uses a keyframe structure and multi-processing computation flow, with dynamic information-guided pixel sampling for speed, with tracking at 10 Hz and global map updating at 2 Hz. The advantages of an implicit MLP over standard dense SLAM techniques include efficient geometry representation with automatic detail control and smooth, plausible filling-in of unobserved regions such as the back surfaces of objects.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 4

page 5

page 6

page 7

page 8

09/18/2017

Direction-Aware Semi-Dense SLAM

To aide simultaneous localization and mapping (SLAM), future perception ...
08/12/2021

Continual Neural Mapping: Learning An Implicit Scene Representation from Sequential Observations

Recent advances have enabled a single neural network to serve as an impl...
04/09/2015

Real-time Monocular Object SLAM

We present a real-time object-based SLAM system that leverages the large...
06/20/2017

Co-Fusion: Real-time Segmentation, Tracking and Fusion of Multiple Objects

In this paper we introduce Co-Fusion, a dense SLAM system that takes a l...
04/03/2018

CodeSLAM - Learning a Compact, Optimisable Representation for Dense Visual SLAM

The representation of geometry in real-time 3D perception systems contin...
11/29/2021

iLabel: Interactive Neural Scene Labelling

Joint representation of geometry, colour and semantics using a 3D neural...
04/20/2018

High Dynamic Range SLAM with Map-Aware Exposure Time Control

The research in dense online 3D mapping is mostly focused on the geometr...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.