Comparing View-Based and Map-Based Semantic Labelling in Real-Time SLAM

02/24/2020
by   Zoe Landgraf, et al.
6

Generally capable Spatial AI systems must build persistent scene representations where geometric models are combined with meaningful semantic labels. The many approaches to labelling scenes can be divided into two clear groups: view-based which estimate labels from the input view-wise data and then incrementally fuse them into the scene model as it is built; and map-based which label the generated scene model. However, there has so far been no attempt to quantitatively compare view-based and map-based labelling. Here, we present an experimental framework and comparison which uses real-time height map fusion as an accessible platform for a fair comparison, opening up the route to further systematic research in this area.

READ FULL TEXT

page 1

page 4

page 5

page 6

research
03/29/2021

In-Place Scene Labelling and Understanding with Implicit Scene Representation

Semantic labelling is highly correlated with geometry and radiance recon...
research
11/29/2021

iLabel: Interactive Neural Scene Labelling

Joint representation of geometry, colour and semantics using a 3D neural...
research
10/13/2015

SemanticPaint: A Framework for the Interactive Segmentation of 3D Scenes

We present an open-source, real-time implementation of SemanticPaint, a ...
research
04/24/2018

MaskFusion: Real-Time Recognition, Tracking and Reconstruction of Multiple Moving Objects

We present MaskFusion, a real-time, object-aware, semantic and dynamic R...
research
06/17/2019

Semi-Supervised Semantic Mapping through Label Propagation with Semantic Texture Meshes

Scene understanding is an important capability for robots acting in unst...
research
03/07/2018

Fast and Accurate Semantic Mapping through Geometric-based Incremental Segmentation

We propose an efficient and scalable method for incrementally building a...
research
12/04/2017

3D Semantic Trajectory Reconstruction from 3D Pixel Continuum

This paper presents a method to reconstruct dense semantic trajectory st...

Please sign up or login with your details

Forgot password? Click here to reset