DeepAI AI Chat
Log In Sign Up

Rendering the Directional TSDF for Tracking and Multi-Sensor Registration with Point-To-Plane Scale ICP

by   Malte Splietker, et al.

Dense real-time tracking and mapping from RGB-D images is an important tool for many robotic applications, such as navigation and manipulation. The recently presented Directional Truncated Signed Distance Function (DTSDF) is an augmentation of the regular TSDF that shows potential for more coherent maps and improved tracking performance. In this work, we present methods for rendering depth- and color images from the DTSDF, making it a true drop-in replacement for the regular TSDF in established trackers. We evaluate the algorithm on well-established datasets and observe that our method improves tracking performance and increases re-usability of mapped scenes. Furthermore, we add color integration which notably improves color-correctness at adjacent surfaces. Our novel formulation of combined ICP with frame-to-keyframe photometric error minimization further improves tracking results. Lastly, we introduce Sim3 point-to-plane ICP for refining pose priors in a multi-sensor scenario with different scale factors.


page 1

page 4

page 6

page 7

page 8

page 10

page 12

page 15


Rendering and Tracking the Directional TSDF: Modeling Surface Orientation for Coherent Maps

Dense real-time tracking and mapping from RGB-D images is an important t...

Directional TSDF: Modeling Surface Orientation for Coherent Meshes

Real-time 3D reconstruction from RGB-D sensor data plays an important ro...

ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residuals

Mapping and localization are essential capabilities of robotic systems. ...

Real-Time 3D Model Tracking in Color and Depth on a Single CPU Core

We present a novel method to track 3D models in color and depth data. To...

Structure-From-Motion and RGBD Depth Fusion

This article describes a technique to augment a typical RGBD sensor by i...

Tracking and Planning with Spatial World Models

We introduce a method for real-time navigation and tracking with differe...