RPM-Net: Robust Point Matching using Learned Features

03/30/2020
by   Zi Jian Yew, et al.
0

Iterative Closest Point (ICP) solves the rigid point cloud registration problem iteratively in two steps: (1) make hard assignments of spatially closest point correspondences, and then (2) find the least-squares rigid transformation. The hard assignments of closest point correspondences based on spatial distances are sensitive to the initial rigid transformation and noisy/outlier points, which often cause ICP to converge to wrong local minima. In this paper, we propose the RPM-Net – a less sensitive to initialization and more robust deep learning-based approach for rigid point cloud registration. To this end, our network uses the differentiable Sinkhorn layer and annealing to get soft assignments of point correspondences from hybrid features learned from both spatial coordinates and local geometry. To further improve registration performance, we introduce a secondary network to predict optimal annealing parameters. Unlike some existing methods, our RPM-Net handles missing correspondences and point clouds with partial visibility. Experimental results show that our RPM-Net achieves state-of-the-art performance compared to existing non-deep learning and recent deep learning methods. Our source code is available at the project website https://github.com/yewzijian/RPMNet .

READ FULL TEXT
research
03/07/2021

Robust Point Cloud Registration Framework Based on Deep Graph Matching

3D point cloud registration is a fundamental problem in computer vision ...
research
03/17/2023

Deep Graph-based Spatial Consistency for Robust Non-rigid Point Cloud Registration

We study the problem of outlier correspondence pruning for non-rigid poi...
research
09/28/2022

Category-Level Global Camera Pose Estimation with Multi-Hypothesis Point Cloud Correspondences

Correspondence search is an essential step in rigid point cloud registra...
research
05/08/2019

Deep Closest Point: Learning Representations for Point Cloud Registration

Point cloud registration is a key problem for computer vision applied to...
research
10/28/2021

End-to-end Learning the Partial Permutation Matrix for Robust 3D Point Cloud Registration

Even though considerable progress has been made in deep learning-based 3...
research
03/29/2023

HybridPoint: Point Cloud Registration Based on Hybrid Point Sampling and Matching

Patch-to-point matching has become a robust way of point cloud registrat...
research
07/03/2023

Direct Superpoints Matching for Fast and Robust Point Cloud Registration

Although deep neural networks endow the downsampled superpoints with dis...

Please sign up or login with your details

Forgot password? Click here to reset