Semantic Flow-guided Motion Removal Method for Robust Mapping

10/14/2020
by   Xudong Lv, et al.
0

Moving objects in scenes are still a severe challenge for the SLAM system. Many efforts have tried to remove the motion regions in the images by detecting moving objects. In this way, the keypoints belonging to motion regions will be ignored in the later calculations. In this paper, we proposed a novel motion removal method, leveraging semantic information and optical flow to extract motion regions. Different from previous works, we don't predict moving objects or motion regions directly from image sequences. We computed rigid optical flow, synthesized by the depth and pose, and compared it against the estimated optical flow to obtain initial motion regions. Then, we utilized K-means to finetune the motion region masks with instance segmentation masks. The ORB-SLAM2 integrated with the proposed motion removal method achieved the best performance in both indoor and outdoor dynamic environments.

READ FULL TEXT
research
05/03/2017

Optical Flow in Mostly Rigid Scenes

The optical flow of natural scenes is a combination of the motion of the...
research
07/05/2017

Fast Multi-frame Stereo Scene Flow with Motion Segmentation

We propose a new multi-frame method for efficiently computing scene flow...
research
08/07/2019

Mono-Stixels: Monocular depth reconstruction of dynamic street scenes

In this paper we present mono-stixels, a compact environment representat...
research
03/12/2016

Optical Flow with Semantic Segmentation and Localized Layers

Existing optical flow methods make generic, spatially homogeneous, assum...
research
05/24/2018

Adversarial Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentation

We address the unsupervised learning of several interconnected problems ...
research
10/20/2019

Moving Indoor: Unsupervised Video Depth Learning in Challenging Environments

Recently unsupervised learning of depth from videos has made remarkable ...
research
12/07/2019

Temporal Wasserstein non-negative matrix factorization for non-rigid motion segmentation and spatiotemporal deconvolution

Motion segmentation for natural images commonly relies on dense optic fl...

Please sign up or login with your details

Forgot password? Click here to reset