PnP-Net: A hybrid Perspective-n-Point Network

03/10/2020
by   Roy Sheffer, et al.
20

We consider the robust Perspective-n-Point (PnP) problem using a hybrid approach that combines deep learning with model based algorithms. PnP is the problem of estimating the pose of a calibrated camera given a set of 3D points in the world and their corresponding 2D projections in the image. In its more challenging robust version, some of the correspondences may be mismatched and must be efficiently discarded. Classical solutions address PnP via iterative robust non-linear least squares method that exploit the problem's geometry but are either inaccurate or computationally intensive. In contrast, we propose to combine a deep learning initial phase followed by a model-based fine tuning phase. This hybrid approach, denoted by PnP-Net, succeeds in estimating the unknown pose parameters under correspondence errors and noise, with low and fixed computational complexity requirements. We demonstrate its advantages on both synthetic data and real world data.

READ FULL TEXT

page 11

page 12

page 13

research
09/29/2022

Partially calibrated semi-generalized pose from hybrid point correspondences

In this paper we study the problem of estimating the semi-generalized po...
research
03/11/2021

Calibrated and Partially Calibrated Semi-Generalized Homographies

In this paper, we propose the first minimal solutions for estimating the...
research
11/17/2020

P1AC: Revisiting Absolute Pose From a Single Affine Correspondence

We introduce a novel solution to the problem of estimating the pose of a...
research
07/29/2020

Solving the Blind Perspective-n-Point Problem End-To-End With Robust Differentiable Geometric Optimization

Blind Perspective-n-Point (PnP) is the problem of estimating the positio...
research
08/09/2020

1-Point RANSAC-Based Method for Ground Object Pose Estimation

Solving Perspective-n-Point (PnP) problems is a traditional way of estim...
research
12/12/2019

Estimating 3D Camera Pose from 2D Pedestrian Trajectories

We consider the task of re-calibrating the 3D pose of a static surveilla...
research
09/13/2022

CPnP: Consistent Pose Estimator for Perspective-n-Point Problem with Bias Elimination

The Perspective-n-Point (PnP) problem has been widely studied in both co...

Please sign up or login with your details

Forgot password? Click here to reset