Active Image Indexing

10/05/2022
by   Pierre Fernandez, et al.
0

Image copy detection and retrieval from large databases leverage two components. First, a neural network maps an image to a vector representation, that is relatively robust to various transformations of the image. Second, an efficient but approximate similarity search algorithm trades scalability (size and speed) against quality of the search, thereby introducing a source of error. This paper improves the robustness of image copy detection with active indexing, that optimizes the interplay of these two components. We reduce the quantization loss of a given image representation by making imperceptible changes to the image before its release. The loss is back-propagated through the deep neural network back to the image, under perceptual constraints. These modifications make the image more retrievable. Our experiments show that the retrieval and copy detection of activated images is significantly improved. For instance, activation improves by +40% the Recall1@1 on various image transformations, and for several popular indexing structures based on product quantization and locality sensitivity hashing.

READ FULL TEXT
research
06/08/2018

A neural network catalyzer for multi-dimensional similarity search

This paper aims at learning a function mapping input vectors to an outpu...
research
10/31/2017

Deep Hashing with Triplet Quantization Loss

With the explosive growth of image databases, deep hashing, which learns...
research
02/01/2021

Rescuing Deep Hashing from Dead Bits Problem

Deep hashing methods have shown great retrieval accuracy and efficiency ...
research
05/09/2021

Joint Learning of Deep Retrieval Model and Product Quantization based Embedding Index

Embedding index that enables fast approximate nearest neighbor(ANN) sear...
research
10/30/2016

Accurate Deep Representation Quantization with Gradient Snapping Layer for Similarity Search

Recent advance of large scale similarity search involves using deeply le...
research
07/08/2022

Copy Propagation subsumes Constant Propagation

Constant propagation and copy propagation are code transformations that ...
research
12/12/2017

Learning a Complete Image Indexing Pipeline

To work at scale, a complete image indexing system comprises two compone...

Please sign up or login with your details

Forgot password? Click here to reset