Iterative Corresponding Geometry: Fusing Region and Depth for Highly Efficient 3D Tracking of Textureless Objects

03/10/2022
by   Manuel Stoiber, et al.
0

Tracking objects in 3D space and predicting their 6DoF pose is an essential task in computer vision. State-of-the-art approaches often rely on object texture to tackle this problem. However, while they achieve impressive results, many objects do not contain sufficient texture, violating the main underlying assumption. In the following, we thus propose ICG, a novel probabilistic tracker that fuses region and depth information and only requires the object geometry. Our method deploys correspondence lines and points to iteratively refine the pose. We also implement robust occlusion handling to improve performance in real-world settings. Experiments on the YCB-Video, OPT, and Choi datasets demonstrate that, even for textured objects, our approach outperforms the current state of the art with respect to accuracy and robustness. At the same time, ICG shows fast convergence and outstanding efficiency, requiring only 1.3 ms per frame on a single CPU core. Finally, we analyze the influence of individual components and discuss our performance compared to deep learning-based methods. The source code of our tracker is publicly available.

READ FULL TEXT
research
02/22/2023

Fusing Visual Appearance and Geometry for Multi-modality 6DoF Object Tracking

In many applications of advanced robotic manipulation, six degrees of fr...
research
10/25/2021

SRT3D: A Sparse Region-Based 3D Object Tracking Approach for the Real World

Region-based methods have become increasingly popular for model-based, m...
research
07/05/2018

Subpixel-Precise Tracking of Rigid Objects in Real-time

We present a novel object tracking scheme that can track rigid objects i...
research
09/05/2017

6D Object Pose Estimation with Depth Images: A Seamless Approach for Robotic Interaction and Augmented Reality

To determine the 3D orientation and 3D location of objects in the surrou...
research
05/26/2017

Learning a Robust Society of Tracking Parts

Object tracking is an essential task in computer vision that has been st...
research
03/24/2023

BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects

We present a near real-time method for 6-DoF tracking of an unknown obje...
research
01/09/2017

A Learning-based Variable Size Part Extraction Architecture for 6D Object Pose Recovery in Depth

State-of-the-art techniques for 6D object pose recovery depend on occlus...

Please sign up or login with your details

Forgot password? Click here to reset