Rendering the Directional TSDF for Tracking and Multi-Sensor Registration with Point-To-Plane Scale ICP

01/30/2023
by   Malte Splietker, et al.
0

Dense real-time tracking and mapping from RGB-D images is an important tool for many robotic applications, such as navigation and manipulation. The recently presented Directional Truncated Signed Distance Function (DTSDF) is an augmentation of the regular TSDF that shows potential for more coherent maps and improved tracking performance. In this work, we present methods for rendering depth- and color images from the DTSDF, making it a true drop-in replacement for the regular TSDF in established trackers. We evaluate the algorithm on well-established datasets and observe that our method improves tracking performance and increases re-usability of mapped scenes. Furthermore, we add color integration which notably improves color-correctness at adjacent surfaces. Our novel formulation of combined ICP with frame-to-keyframe photometric error minimization further improves tracking results. Lastly, we introduce Sim3 point-to-plane ICP for refining pose priors in a multi-sensor scenario with different scale factors.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 8

page 10

page 12

page 15

research
08/18/2021

Rendering and Tracking the Directional TSDF: Modeling Surface Orientation for Coherent Maps

Dense real-time tracking and mapping from RGB-D images is an important t...
research
08/14/2019

Directional TSDF: Modeling Surface Orientation for Coherent Meshes

Real-time 3D reconstruction from RGB-D sensor data plays an important ro...
research
05/06/2019

ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residuals

Mapping and localization are essential capabilities of robotic systems. ...
research
11/22/2019

Real-Time 3D Model Tracking in Color and Depth on a Single CPU Core

We present a novel method to track 3D models in color and depth data. To...
research
03/10/2021

Structure-From-Motion and RGBD Depth Fusion

This article describes a technique to augment a typical RGBD sensor by i...
research
01/25/2022

Tracking and Planning with Spatial World Models

We introduce a method for real-time navigation and tracking with differe...

Please sign up or login with your details

Forgot password? Click here to reset