DeepAI AI Chat
Log In Sign Up

Learning to Segment Dynamic Objects using SLAM Outliers

by   Adrian Bojko, et al.

We present a method to automatically learn to segment dynamic objects using SLAM outliers. It requires only one monocular sequence per dynamic object for training and consists in localizing dynamic objects using SLAM outliers, creating their masks, and using these masks to train a semantic segmentation network. We integrate the trained network in ORB-SLAM 2 and LDSO. At runtime we remove features on dynamic objects, making the SLAM unaffected by them. We also propose a new stereo dataset and new metrics to evaluate SLAM robustness. Our dataset includes consensus inversions, i.e., situations where the SLAM uses more features on dynamic objects that on the static background. Consensus inversions are challenging for SLAM as they may cause major SLAM failures. Our approach performs better than the State-of-the-Art on the TUM RGB-D dataset in monocular mode and on our dataset in both monocular and stereo modes.


page 1

page 4

page 5

page 7


The STDyn-SLAM: A stereo vision and semantic segmentation approach for SLAM in dynamic outdoor environments

Commonly, SLAM algorithms are focused on a static environment, however, ...

Real-time SLAM Pipeline in Dynamics Environment

Inspired by the recent success of application of dense data approach by ...

Det-SLAM: A semantic visual SLAM for highly dynamic scenes using Detectron2

According to experts, Simultaneous Localization and Mapping (SLAM) is an...

RGB-D SLAM in Indoor Planar Environments with Multiple Large Dynamic Objects

This work presents a novel dense RGB-D SLAM approach for dynamic planar ...

Self-Improving SLAM in Dynamic Environments: Learning When to Mask

Visual SLAM – Simultaneous Localization and Mapping – in dynamic environ...

DynSLAM: Tracking, Mapping and Inpainting in Dynamic Scenes

The assumption of scene rigidity is typical in SLAM algorithms. Such a s...

Dynamic Object Removal for Effective Slam

This research paper focuses on the problem of dynamic objects and their ...