On the Role of Geometry in Geo-Localization

06/26/2019
by   Moti Kadosh, et al.
12

Humans can build a mental map of a geographical area to find their way and recognize places. The basic task we consider is geo-localization - finding the pose (position & orientation) of a camera in a large 3D scene from a single image. We aim to experimentally explore the role of geometry in geo-localization in a convolutional neural network (CNN) solution. We do so by ignoring the often available texture of the scene. We therefore deliberately avoid using texture or rich geometric details and use images projected from a simple 3D model of a city, which we term lean images. Lean images contain solely information that relates to the geometry of the area viewed (edges, faces, or relative depth). We find that the network is capable of estimating the camera pose from the lean images, and it does so not by memorization but by some measure of geometric learning of the geographical area. The main contributions of this paper are: (i) providing insight into the role of geometry in the CNN learning process; and (ii) demonstrating the power of CNNs for recovering camera pose using lean images.

READ FULL TEXT

page 2

page 4

research
04/02/2017

Geometric Loss Functions for Camera Pose Regression with Deep Learning

Deep learning has shown to be effective for robust and real-time monocul...
research
03/19/2021

CoordiNet: uncertainty-aware pose regressor for reliable vehicle localization

In this paper, we investigate visual-based camera localization with neur...
research
05/08/2018

Visual Global Localization with a Hybrid WNN-CNN Approach

Currently, self-driving cars rely greatly on the Global Positioning Syst...
research
08/19/2019

UprightNet: Geometry-Aware Camera Orientation Estimation from Single Images

We introduce UprightNet, a learning-based approach for estimating 2DoF c...
research
03/24/2020

On Localizing a Camera from a Single Image

Public cameras often have limited metadata describing their attributes. ...
research
02/04/2020

Deep-Geometric 6 DoF Localization from a Single Image in Topo-metric Maps

We describe a Deep-Geometric Localizer that is able to estimate the full...
research
10/11/2022

Map-free Visual Relocalization: Metric Pose Relative to a Single Image

Can we relocalize in a scene represented by a single reference image? St...

Please sign up or login with your details

Forgot password? Click here to reset