Deep Image Retrieval: Learning global representations for image search

04/05/2016
by   Albert Gordo, et al.
0

We propose a novel approach for instance-level image retrieval. It produces a global and compact fixed-length representation for each image by aggregating many region-wise descriptors. In contrast to previous works employing pre-trained deep networks as a black box to produce features, our method leverages a deep architecture trained for the specific task of image retrieval. Our contribution is twofold: (i) we leverage a ranking framework to learn convolution and projection weights that are used to build the region features; and (ii) we employ a region proposal network to learn which regions should be pooled to form the final global descriptor. We show that using clean training data is key to the success of our approach. To that aim, we use a large scale but noisy landmark dataset and develop an automatic cleaning approach. The proposed architecture produces a global image representation in a single forward pass. Our approach significantly outperforms previous approaches based on global descriptors on standard datasets. It even surpasses most prior works based on costly local descriptor indexing and spatial verification. Additional material is available at www.xrce.xerox.com/Deep-Image-Retrieval.

READ FULL TEXT

page 8

page 9

page 11

page 18

page 19

research
10/25/2016

End-to-end Learning of Deep Visual Representations for Image Retrieval

While deep learning has become a key ingredient in the top performing me...
research
12/19/2016

Large-Scale Image Retrieval with Attentive Deep Local Features

We propose an attentive local feature descriptor suitable for large-scal...
research
03/26/2019

Combination of Multiple Global Descriptors for Image Retrieval

Recent studies in image retrieval task have shown that ensembling differ...
research
03/22/2021

Instance-level Image Retrieval using Reranking Transformers

Instance-level image retrieval is the task of searching in a large datab...
research
10/20/2014

Supervised mid-level features for word image representation

This paper addresses the problem of learning word image representations:...
research
11/27/2016

Voronoi-based compact image descriptors: Efficient Region-of-Interest retrieval with VLAD and deep-learning-based descriptors

We investigate the problem of image retrieval based on visual queries wh...
research
01/10/2022

Why-So-Deep: Towards Boosting Previously Trained Models for Visual Place Recognition

Deep learning-based image retrieval techniques for the loop closure dete...

Please sign up or login with your details

Forgot password? Click here to reset