Geometrically Mappable Image Features

03/21/2020
by   Janine Thoma, et al.
2

Vision-based localization of an agent in a map is an important problem in robotics and computer vision. In that context, localization by learning matchable image features is gaining popularity due to recent advances in machine learning. Features that uniquely describe the visual contents of images have a wide range of applications, including image retrieval and understanding. In this work, we propose a method that learns image features targeted for image-retrieval-based localization. Retrieval-based localization has several benefits, such as easy maintenance and quick computation. However, the state-of-the-art features only provide visual similarity scores which do not explicitly reveal the geometric distance between query and retrieved images. Knowing this distance is highly desirable for accurate localization, especially when the reference images are sparsely distributed in the scene. Therefore, we propose a novel loss function for learning image features which are both visually representative and geometrically relatable. This is achieved by guiding the learning process such that the feature and geometric distances between images are directly proportional. In our experiments we show that our features not only offer significantly better localization accuracy, but also allow to estimate the trajectory of a query sequence in absence of the reference images.

READ FULL TEXT

page 1

page 4

page 6

page 7

research
11/24/2020

Benchmarking Image Retrieval for Visual Localization

Visual localization, i.e., camera pose estimation in a known scene, is a...
research
02/25/2021

Scene Retrieval for Contextual Visual Mapping

Visual navigation localizes a query place image against a reference data...
research
06/27/2019

BTEL: A Binary Tree Encoding Approach for Visual Localization

Visual localization algorithms have achieved significant improvements in...
research
11/07/2019

Improved Visual Localization via Graph Smoothing

Vision based localization is the problem of inferring the pose of the ca...
research
09/03/2021

Deep Metric Learning for Ground Images

Ground texture based localization methods are potential prospects for lo...
research
12/30/2021

Visual and Object Geo-localization: A Comprehensive Survey

The concept of geo-localization refers to the process of determining whe...
research
09/26/2018

Night-to-Day Image Translation for Retrieval-based Localization

Visual localization is a key step in many robotics pipelines, allowing t...

Please sign up or login with your details

Forgot password? Click here to reset