To Learn or Not to Learn: Visual Localization from Essential Matrices

08/04/2019
by   Qunjie Zhou, et al.
4

Visual localization is the problem of estimating a camera within a scene and a key component in computer vision applications such as self-driving cars and Mixed Reality. State-of-the-art approaches for accurate visual localization use scene-specific representations, resulting in the overhead of constructing these models when applying the techniques to new scenes. Recently, deep learning-based approaches based on relative pose estimation have been proposed, carrying the promise of easily adapting to new scenes. However, it has been shown such approaches are currently significantly less accurate than state-of-the-art approaches. In this paper, we are interested in analyzing this behavior. To this end, we propose a novel framework for visual localization from relative poses. Using a classical feature-based approach within this framework, we show state-of-the-art performance. Replacing the classical approach with learned alternatives at various levels, we then identify the reasons for why deep learned approaches do not perform well. Based on our analysis, we make recommendations for future work.

READ FULL TEXT
research
03/18/2019

Understanding the Limitations of CNN-based Absolute Camera Pose Regression

Visual localization is the task of accurate camera pose estimation in a ...
research
11/02/2022

Optimizing Fiducial Marker Placement for Improved Visual Localization

Adding fiducial markers to a scene is a well-known strategy for making v...
research
08/18/2023

3D Model-free Visual localization System from Essential Matrix under Local Planar Motion

Visual localization plays a critical role in the functionality of low-co...
research
11/09/2020

Learning to Localize in New Environments from Synthetic Training Data

Most existing approaches for visual localization either need a detailed ...
research
09/23/2020

Insights on Evaluation of Camera Re-localization Using Relative Pose Regression

We consider the problem of relative pose regression in visual relocaliza...
research
12/02/2020

Cross-Descriptor Visual Localization and Mapping

Visual localization and mapping is the key technology underlying the maj...
research
03/07/2023

Where We Are and What We're Looking At: Query Based Worldwide Image Geo-localization Using Hierarchies and Scenes

Determining the exact latitude and longitude that a photo was taken is a...

Please sign up or login with your details

Forgot password? Click here to reset