DeepAI AI Chat
Log In Sign Up

Characterizing SLAM Benchmarks and Methods for the Robust Perception Age

by   Wenkai Ye, et al.
Georgia Institute of Technology

The diversity of SLAM benchmarks affords extensive testing of SLAM algorithms to understand their performance, individually or in relative terms. The ad-hoc creation of these benchmarks does not necessarily illuminate the particular weak points of a SLAM algorithm when performance is evaluated. In this paper, we propose to use a decision tree to identify challenging benchmark properties for state-of-the-art SLAM algorithms and important components within the SLAM pipeline regarding their ability to handle these challenges. Establishing what factors of a particular sequence lead to track failure or degradation relative to these characteristics is important if we are to arrive at a strong understanding for the core computational needs of a robust SLAM algorithm. Likewise, we argue that it is important to profile the computational performance of the individual SLAM components for use when benchmarking. In particular, we advocate the use of time-dilation during ROS bag playback, or what we refer to as slo-mo playback. Using slo-mo to benchmark SLAM instantiations can provide clues to how SLAM implementations should be improved at the computational component level. Three prevalent VO/SLAM algorithms and two low-latency algorithms of our own are tested on selected typical sequences, which are generated from benchmark characterization, to further demonstrate the benefits achieved from computationally efficient components.


page 1

page 3


Benchmarking and Comparing Popular Visual SLAM Algorithms

This paper contains the performance analysis and benchmarking of two pop...

RWT-SLAM: Robust Visual SLAM for Highly Weak-textured Environments

As a fundamental task for intelligent robots, visual SLAM has made great...

Are We Ready for Robust and Resilient SLAM? A Framework For Quantitative Characterization of SLAM Datasets

Reliability of SLAM systems is considered one of the critical requiremen...

GSLAM: A General SLAM Framework and Benchmark

SLAM technology has recently seen many successes and attracted the atten...

Plug-and-Play SLAM: A Unified SLAM Architecture for Modularity and Ease of Use

Nowadays, SLAM (Simultaneous Localization and Mapping) is considered by ...

gradSLAM: Dense SLAM meets Automatic Differentiation

The question of "representation" is central in the context of dense simu...

Online Incremental Non-Gaussian Inference for SLAM Using Normalizing Flows

This paper presents a novel non-Gaussian inference algorithm, Normalizin...