Adversarial Training for Adverse Conditions: Robust Metric Localisation using Appearance Transfer

03/09/2018
by   Horia Porav, et al.
0

We present a method of improving visual place recognition and metric localisation under very strong appear- ance change. We learn an invertable generator that can trans- form the conditions of images, e.g. from day to night, summer to winter etc. This image transforming filter is explicitly designed to aid and abet feature-matching using a new loss based on SURF detector and dense descriptor maps. A network is trained to output synthetic images optimised for feature matching given only an input RGB image, and these generated images are used to localize the robot against a previously built map using traditional sparse matching approaches. We benchmark our results using multiple traversals of the Oxford RobotCar Dataset over a year-long period, using one traversal as a map and the other to localise. We show that this method significantly improves place recognition and localisation under changing and adverse conditions, while reducing the number of mapping runs needed to successfully achieve reliable localisation.

READ FULL TEXT

page 1

page 3

page 4

page 7

research
06/30/2023

DisPlacing Objects: Improving Dynamic Vehicle Detection via Visual Place Recognition under Adverse Conditions

Can knowing where you are assist in perceiving objects in your surroundi...
research
05/09/2023

ColonMapper: topological mapping and localization for colonoscopy

Mapping and localization in endoluminal cavities from colonoscopies or g...
research
04/01/2019

Learning Matchable Colorspace Transformations for Long-term Metric Visual Localization

Long-term metric localization is an essential capability of autonomous m...
research
10/30/2018

Feature Map Filtering: Improving Visual Place Recognition with Convolutional Calibration

Convolutional Neural Networks (CNNs) have recently been shown to excel a...
research
06/22/2023

What to Learn: Features, Image Transformations, or Both?

Long-term visual localization is an essential problem in robotics and co...
research
12/10/2019

SuperNCN: Neighbourhood consensus network for robust outdoor scenes matching

In this paper, we present a framework for computing dense keypoint corre...
research
01/16/2013

Regularized Discriminant Embedding for Visual Descriptor Learning

Images can vary according to changes in viewpoint, resolution, noise, an...

Please sign up or login with your details

Forgot password? Click here to reset