Learning-based Point Cloud Registration for 6D Object Pose Estimation in the Real World

03/29/2022
by   Zheng Dang, et al.
0

In this work, we tackle the task of estimating the 6D pose of an object from point cloud data. While recent learning-based approaches to addressing this task have shown great success on synthetic datasets, we have observed them to fail in the presence of real-world data. We thus analyze the causes of these failures, which we trace back to the difference between the feature distributions of the source and target point clouds, and the sensitivity of the widely-used SVD-based loss function to the range of rotation between the two point clouds. We address the first challenge by introducing a new normalization strategy, Match Normalization, and the second via the use of a loss function based on the negative log likelihood of point correspondences. Our two contributions are general and can be applied to many existing learning-based 3D object registration frameworks, which we illustrate by implementing them in two of them, DCP and IDAM. Our experiments on the real-scene TUD-L, LINEMOD and Occluded-LINEMOD datasets evidence the benefits of our strategies. They allow for the first time learning-based 3D object registration methods to achieve meaningful results on real-world data. We therefore expect them to be key to the future development of point cloud registration methods.

READ FULL TEXT

page 11

page 16

page 17

page 18

page 19

research
03/24/2022

A Representation Separation Perspective to Correspondences-free Unsupervised 3D Point Cloud Registration

3D point cloud registration in remote sensing field has been greatly adv...
research
11/19/2021

What Stops Learning-based 3D Registration from Working in the Real World?

Much progress has been made on the task of learning-based 3D point cloud...
research
09/20/2023

AutoSynth: Learning to Generate 3D Training Data for Object Point Cloud Registration

In the current deep learning paradigm, the amount and quality of trainin...
research
11/23/2020

3D Registration for Self-Occluded Objects in Context

While much progress has been made on the task of 3D point cloud registra...
research
05/30/2023

A Probabilistic Rotation Representation for Symmetric Shapes With an Efficiently Computable Bingham Loss Function

In recent years, a deep learning framework has been widely used for obje...
research
06/07/2021

FINet: Dual Branches Feature Interaction for Partial-to-Partial Point Cloud Registration

Data association is important in the point cloud registration. In this w...
research
08/18/2016

A Systematic Approach for Cross-source Point Cloud Registration by Preserving Macro and Micro Structures

We propose a systematic approach for registering cross-source point clou...

Please sign up or login with your details

Forgot password? Click here to reset