DymSLAM:4D Dynamic Scene Reconstruction Based on Geometrical Motion Segmentation

03/10/2020
by   Chenjie Wang, et al.
6

Most SLAM algorithms are based on the assumption that the scene is static. However, in practice, most scenes are dynamic which usually contains moving objects, these methods are not suitable. In this paper, we introduce DymSLAM, a dynamic stereo visual SLAM system being capable of reconstructing a 4D (3D + time) dynamic scene with rigid moving objects. The only input of DymSLAM is stereo video, and its output includes a dense map of the static environment, 3D model of the moving objects and the trajectories of the camera and the moving objects. We at first detect and match the interesting points between successive frames by using traditional SLAM methods. Then the interesting points belonging to different motion models (including ego-motion and motion models of rigid moving objects) are segmented by a multi-model fitting approach. Based on the interesting points belonging to the ego-motion, we are able to estimate the trajectory of the camera and reconstruct the static background. The interesting points belonging to the motion models of rigid moving objects are then used to estimate their relative motion models to the camera and reconstruct the 3D models of the objects. We then transform the relative motion to the trajectories of the moving objects in the global reference frame. Finally, we then fuse the 3D models of the moving objects into the 3D map of the environment by considering their motion trajectories to obtain a 4D (3D+time) sequence. DymSLAM obtains information about the dynamic objects instead of ignoring them and is suitable for unknown rigid objects. Hence, the proposed system allows the robot to be employed for high-level tasks, such as obstacle avoidance for dynamic objects. We conducted experiments in a real-world environment where both the camera and the objects were moving in a wide range.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 8

research
02/20/2020

Dynamic SLAM: The Need For Speed

The static world assumption is standard in most simultaneous localisatio...
research
04/27/2015

Dynamic Body VSLAM with Semantic Constraints

Image based reconstruction of urban environments is a challenging proble...
research
05/24/2021

Reconstructing Small 3D Objects in front of a Textured Background

We present a technique for a complete 3D reconstruction of small objects...
research
05/07/2019

Robust Dense Mapping for Large-Scale Dynamic Environments

We present a stereo-based dense mapping algorithm for large-scale dynami...
research
08/02/2021

PoseFusion2: Simultaneous Background Reconstruction and Human Shape Recovery in Real-time

Dynamic environments that include unstructured moving objects pose a har...
research
08/02/2016

Incremental Real-Time Multibody VSLAM with Trajectory Optimization Using Stereo Camera

Real time outdoor navigation in highly dynamic environments is an crucia...
research
07/25/2020

Towards 3D Visualization of Video from Frames

We explain theoretically how to reconstruct the 3D scene from successive...

Please sign up or login with your details

Forgot password? Click here to reset