ImLoveNet: Misaligned Image-supported Registration Network for Low-overlap Point Cloud Pairs

07/02/2022
by   Honghua Chen, et al.
5

Low-overlap regions between paired point clouds make the captured features very low-confidence, leading cutting edge models to point cloud registration with poor quality. Beyond the traditional wisdom, we raise an intriguing question: Is it possible to exploit an intermediate yet misaligned image between two low-overlap point clouds to enhance the performance of cutting-edge registration models? To answer it, we propose a misaligned image supported registration network for low-overlap point cloud pairs, dubbed ImLoveNet. ImLoveNet first learns triple deep features across different modalities and then exports these features to a two-stage classifier, for progressively obtaining the high-confidence overlap region between the two point clouds. Therefore, soft correspondences are well established on the predicted overlap region, resulting in accurate rigid transformations for registration. ImLoveNet is simple to implement yet effective, since 1) the misaligned image provides clearer overlap information for the two low-overlap point clouds to better locate overlap parts; 2) it contains certain geometry knowledge to extract better deep features; and 3) it does not require the extrinsic parameters of the imaging device with respect to the reference frame of the 3D point cloud. Extensive qualitative and quantitative evaluations on different kinds of benchmarks demonstrate the effectiveness and superiority of our ImLoveNet over state-of-the-art approaches.

READ FULL TEXT

page 1

page 2

page 3

page 7

page 8

research
11/25/2020

PREDATOR: Registration of 3D Point Clouds with Low Overlap

We introduce PREDATOR, a model for pairwise point-cloud registration wit...
research
08/04/2022

UTOPIC: Uncertainty-aware Overlap Prediction Network for Partial Point Cloud Registration

High-confidence overlap prediction and accurate correspondences are crit...
research
02/28/2023

A Unified BEV Model for Joint Learning of 3D Local Features and Overlap Estimation

Pairwise point cloud registration is a critical task for many applicatio...
research
08/18/2023

Overlap Bias Matching is Necessary for Point Cloud Registration

Point cloud registration is a fundamental problem in many domains. Pract...
research
12/29/2021

COTReg:Coupled Optimal Transport based Point Cloud Registration

Generating a set of high-quality correspondences or matches is one of th...
research
10/26/2021

CoFiNet: Reliable Coarse-to-fine Correspondences for Robust Point Cloud Registration

We study the problem of extracting correspondences between a pair of poi...
research
07/22/2023

Pyramid Semantic Graph-based Global Point Cloud Registration with Low Overlap

Global point cloud registration is essential in many robotics tasks like...

Please sign up or login with your details

Forgot password? Click here to reset