Night-to-Day Image Translation for Retrieval-based Localization

09/26/2018
by   Asha Anoosheh, et al.
2

Visual localization is a key step in many robotics pipelines, allowing the robot to approximately determine its position and orientation in the world. An efficient and scalable approach to visual localization is to use image retrieval techniques. These approaches identify the image most similar to a query photo in a database of geo-tagged images and approximate the query's pose via the pose of the retrieved database image. However, image retrieval across drastically different illumination conditions, e.g. day and night, is still a problem with unsatisfactory results, even in this age of powerful neural models. This is due to a lack of a suitably diverse dataset with true correspondences to perform end-to-end learning. A recent class of neural models allows for realistic translation of images among visual domains with relatively little training data and, most importantly, without ground-truth pairings. In this paper, we explore the task of accurately localizing images captured from two traversals of the same area in both day and night. We propose ToDayGAN - a modified image-translation model to alter nighttime driving images to a more-useful daytime representation. We then compare the daytime and translated-night images to obtain a pose estimate for the night image using the known 6-DOF position of the closest day image. Our approach improves localization performance by over 250 the context of standard metrics in multiple categories.

READ FULL TEXT

page 5

page 7

research
08/11/2020

Retrieval Guided Unsupervised Multi-domain Image-to-Image Translation

Image to image translation aims to learn a mapping that transforms an im...
research
09/23/2019

Retrieval-based Localization Based on Domain-invariant Feature Learning under Changing Environments

Visual localization is a crucial problem in mobile robotics and autonomo...
research
04/01/2023

NPR: Nocturnal Place Recognition in Street

Visual Place Recognition (VPR) is the task of retrieving database images...
research
11/07/2019

Improved Visual Localization via Graph Smoothing

Vision based localization is the problem of inferring the pose of the ca...
research
09/16/2020

Domain-invariant Similarity Activation Map Metric Learning for Retrieval-based Long-term Visual Localization

Visual localization is a crucial component in the application of mobile ...
research
03/21/2020

Geometrically Mappable Image Features

Vision-based localization of an agent in a map is an important problem i...
research
02/10/2018

On-device Scalable Image-based Localization

We present the scalable design of an entire on-device system for large-s...

Please sign up or login with your details

Forgot password? Click here to reset