DeepAI AI Chat
Log In Sign Up

PlueckerNet: Learn to Register 3D Line Reconstructions

by   Liu Liu, et al.

Aligning two partially-overlapped 3D line reconstructions in Euclidean space is challenging, as we need to simultaneously solve correspondences and relative pose between line reconstructions. This paper proposes a neural network based method and it has three modules connected in sequence: (i) a Multilayer Perceptron (MLP) based network takes Pluecker representations of lines as inputs, to extract discriminative line-wise features and matchabilities (how likely each line is going to have a match), (ii) an Optimal Transport (OT) layer takes two-view line-wise features and matchabilities as inputs to estimate a 2D joint probability matrix, with each item describes the matchness of a line pair, and (iii) line pairs with Top-K matching probabilities are fed to a 2-line minimal solver in a RANSAC framework to estimate a six Degree-of-Freedom (6-DoF) rigid transformation. Experiments on both indoor and outdoor datasets show that the registration (rotation and translation) precision of our method outperforms baselines significantly.


page 1

page 2

page 3

page 4


Learning 2D-3D Correspondences To Solve The Blind Perspective-n-Point Problem

Conventional absolute camera pose via a Perspective-n-Point (PnP) solver...

Robust Line Segments Matching via Graph Convolution Networks

Line matching plays an essential role in structure from motion (SFM) and...

Trifocal Relative Pose from Lines at Points and its Efficient Solution

We present a new minimal problem for relative pose estimation mixing poi...

IDLL: Inverse Depth Line based Visual Localization in Challenging Environments

Precise and real-time localization of unmanned aerial vehicles (UAVs) or...

Pose Refinement with Joint Optimization of Visual Points and Lines

High-precision camera re-localization technology in a pre-established 3D...

Full-pulse Tomographic Reconstruction with Deep Neural Networks

Plasma tomography consists in reconstructing the 2D radiation profile in...

Turning machines

Molecular robotics is challenging, so it seems best to keep it simple. W...