Vision Transformer Hashing for Image Retrieval

09/26/2021
by   Shiv Ram Dubey, et al.
0

Deep learning has shown a tremendous growth in hashing techniques for image retrieval. Recently, Transformer has emerged as a new architecture by utilizing self-attention without convolution. Transformer is also extended to Vision Transformer (ViT) for the visual recognition with a promising performance on ImageNet. In this paper, we propose a Vision Transformer based Hashing (VTS) for image retrieval. We utilize the pre-trained ViT on ImageNet as the backbone network and add the hashing head. The proposed VTS model is fine tuned for hashing under six different image retrieval frameworks, including Deep Supervised Hashing (DSH), HashNet, GreedyHash, Improved Deep Hashing Network (IDHN), Deep Polarized Network (DPN) and Central Similarity Quantization (CSQ) with their objective functions. We perform the extensive experiments on CIFAR10, ImageNet, NUS-Wide, and COCO datasets. The proposed VTS based image retrieval outperforms the recent state-of-the-art hashing techniques with a great margin. We also find the proposed VTS model as the backbone network is better than the existing networks, such as AlexNet and ResNet.

READ FULL TEXT
research
05/05/2021

TransHash: Transformer-based Hamming Hashing for Efficient Image Retrieval

Deep hamming hashing has gained growing popularity in approximate neares...
research
01/31/2019

Semantic Hierarchy Preserving Deep Hashing for Large-scale Image Retrieval

Convolutional neural networks have been widely used in content-based ima...
research
03/17/2021

Improved Deep Classwise Hashing With Centers Similarity Learning for Image Retrieval

Deep supervised hashing for image retrieval has attracted researchers' a...
research
12/04/2021

HHF: Hashing-guided Hinge Function for Deep Hashing Retrieval

Deep hashing has shown promising performance in large-scale image retrie...
research
04/09/2023

Unsupervised Multi-Criteria Adversarial Detection in Deep Image Retrieval

The vulnerability in the algorithm supply chain of deep learning has imp...
research
01/16/2019

Deep Supervised Hashing leveraging Quadratic Spherical Mutual Information for Content-based Image Retrieval

Several deep supervised hashing techniques have been proposed to allow f...
research
03/08/2018

Learning Effective Binary Visual Representations with Deep Networks

Although traditionally binary visual representations are mainly designed...

Please sign up or login with your details

Forgot password? Click here to reset