ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residuals

05/06/2019
by   Emanuele Palazzolo, et al.
0

Mapping and localization are essential capabilities of robotic systems. Although the majority of mapping systems focus on static environments, the deployment in real-world situations requires them to handle dynamic objects. In this paper, we propose an approach for an RGB-D sensor that is able to consistently map scenes containing multiple dynamic elements. For localization and mapping, we employ an efficient direct tracking on the truncated signed distance function (TSDF) and leverage color information encoded in the TSDF to estimate the pose of the sensor. The TSDF is efficiently represented using voxel hashing, with most computations parallelized on a GPU. For detecting dynamics, we exploit the residuals obtained after an initial registration, together with the explicit modeling of free space in the model. We evaluate our approach on existing datasets, and provide a new dataset showing highly dynamic scenes. These experiments show that our approach often surpass other state-of-the-art dense SLAM methods. We make available our dataset with the ground truth for both the trajectory of the RGB-D sensor obtained by a motion capture system and the model of the static environment using a high-precision terrestrial laser scanner. Finally, we release our approach as open source code.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 8

research
09/21/2022

Visual Localization and Mapping in Dynamic and Changing Environments

The real-world deployment of fully autonomous mobile robots depends on a...
research
03/24/2022

MD-SLAM: Multi-cue Direct SLAM

Simultaneous Localization and Mapping (SLAM) systems are fundamental bui...
research
02/23/2023

Amos-SLAM: An Anti-Dynamics Two-stage SLAM Approach

The traditional Simultaneous Localization And Mapping (SLAM) systems rel...
research
01/30/2023

Rendering the Directional TSDF for Tracking and Multi-Sensor Registration with Point-To-Plane Scale ICP

Dense real-time tracking and mapping from RGB-D images is an important t...
research
05/02/2022

POCD: Probabilistic Object-Level Change Detection and Volumetric Mapping in Semi-Static Scenes

Maintaining an up-to-date map to reflect recent changes in the scene is ...
research
06/19/2023

UncLe-SLAM: Uncertainty Learning for Dense Neural SLAM

We present an uncertainty learning framework for dense neural simultaneo...
research
04/20/2023

Dynablox: Real-time Detection of Diverse Dynamic Objects in Complex Environments

Real-time detection of moving objects is an essential capability for rob...

Please sign up or login with your details

Forgot password? Click here to reset