Attention-Aware Age-Agnostic Visual Place Recognition

09/11/2019
by   Ziqi Wang, et al.
0

A cross-domain visual place recognition (VPR) task is proposed in this work, i.e., matching images of the same architectures depicted in different domains. VPR is commonly treated as an image retrieval task, where a query image from an unknown location is matched with relevant instances from geo-tagged gallery database. Different from conventional VPR settings where the query images and gallery images come from the same domain, we propose a more common but challenging setup where the query images are collected under a new unseen condition. The two domains involved in this work are contemporary street view images of Amsterdam from the Mapillary dataset (source domain) and historical images of the same city from Beeldbank dataset (target domain). We tailored an age-invariant feature learning CNN that can focus on domain invariant objects and learn to match images based on a weakly supervised ranking loss. We propose an attention aggregation module that is robust to domain discrepancy between the train and the test data. Further, a multi-kernel maximum mean discrepancy (MK-MMD) domain adaptation loss is adopted to improve the cross-domain ranking performance. Both attention and adaptation modules are unsupervised while the ranking loss uses weak supervision. Visual inspection shows that the attention module focuses on built forms while the dramatically changing environment are less weighed. Our proposed CNN achieves state of the art results (99 on the single-domain VPR task and 20 VPR task, revealing the difficulty of age-invariant VPR.

READ FULL TEXT

page 2

page 7

research
10/14/2020

Adaptive-Attentive Geolocalization from few queries: a hybrid approach

We address the task of cross-domain visual place recognition, where the ...
research
03/30/2018

Cross-Domain Weakly-Supervised Object Detection through Progressive Domain Adaptation

Can we detect common objects in a variety of image domains without insta...
research
04/12/2023

Are Local Features All You Need for Cross-Domain Visual Place Recognition?

Visual Place Recognition is a task that aims to predict the coordinates ...
research
11/06/2021

Domain Attention Consistency for Multi-Source Domain Adaptation

Most existing multi-source domain adaptation (MSDA) methods minimize the...
research
09/08/2019

Cross Domain Image Matching in Presence of Outliers

Cross domain image matching between image collections from different sou...
research
07/20/2022

Feature Representation Learning for Unsupervised Cross-domain Image Retrieval

Current supervised cross-domain image retrieval methods can achieve exce...
research
04/18/2019

Unsupervised Open Domain Recognition by Semantic Discrepancy Minimization

We address the unsupervised open domain recognition (UODR) problem, wher...

Please sign up or login with your details

Forgot password? Click here to reset