Two-stage Discriminative Re-ranking for Large-scale Landmark Retrieval

03/25/2020
by   Shuhei Yokoo, et al.
7

We propose an efficient pipeline for large-scale landmark image retrieval that addresses the diversity of the dataset through two-stage discriminative re-ranking. Our approach is based on embedding the images in a feature-space using a convolutional neural network trained with a cosine softmax loss. Due to the variance of the images, which include extreme viewpoint changes such as having to retrieve images of the exterior of a landmark from images of the interior, this is very challenging for approaches based exclusively on visual similarity. Our proposed re-ranking approach improves the results in two steps: in the sort-step, k-nearest neighbor search with soft-voting to sort the retrieved results based on their label similarity to the query images, and in the insert-step, we add additional samples from the dataset that were not retrieved by image-similarity. This approach allows overcoming the low visual diversity in retrieved images. In-depth experimental results show that the proposed approach significantly outperforms existing approaches on the challenging Google Landmarks Datasets. Using our methods, we achieved 1st place in the Google Landmark Retrieval 2019 challenge and 3rd place in the Google Landmark Recognition 2019 challenge on Kaggle. Our code is publicly available here: <https://github.com/lyakaap/Landmark2019-1st-and-3rd-Place-Solution>

READ FULL TEXT

page 1

page 4

page 6

research
06/10/2019

Large-scale Landmark Retrieval/Recognition under a Noisy and Diverse Dataset

The Google-Landmarks-v2 dataset is the biggest worldwide landmarks datas...
research
10/04/2020

Supporting large-scale image recognition with out-of-domain samples

This article presents an efficient end-to-end method to perform instance...
research
04/03/2020

Google Landmarks Dataset v2 – A Large-Scale Benchmark for Instance-Level Recognition and Retrieval

While image retrieval and instance recognition techniques are progressin...
research
03/21/2023

Data-efficient Large Scale Place Recognition with Graded Similarity Supervision

Visual place recognition (VPR) is a fundamental task of computer vision ...
research
06/15/2018

Efficient Nearest Neighbors Search for Large-Scale Landmark Recognition

The problem of landmark recognition has achieved excellent results in sm...
research
08/03/2022

Content-Based Landmark Retrieval Combining Global and Local Features using Siamese Neural Networks

In this work, we present a method for landmark retrieval that utilizes g...
research
05/30/2020

Retrieval of Family Members Using Siamese Neural Network

Retrieval of family members in the wild aims at finding family members o...

Please sign up or login with your details

Forgot password? Click here to reset