Unsupervised Hashing with Semantic Concept Mining

09/23/2022
by   Rong-Cheng Tu, et al.
0

Recently, to improve the unsupervised image retrieval performance, plenty of unsupervised hashing methods have been proposed by designing a semantic similarity matrix, which is based on the similarities between image features extracted by a pre-trained CNN model. However, most of these methods tend to ignore high-level abstract semantic concepts contained in images. Intuitively, concepts play an important role in calculating the similarity among images. In real-world scenarios, each image is associated with some concepts, and the similarity between two images will be larger if they share more identical concepts. Inspired by the above intuition, in this work, we propose a novel Unsupervised Hashing with Semantic Concept Mining, called UHSCM, which leverages a VLP model to construct a high-quality similarity matrix. Specifically, a set of randomly chosen concepts is first collected. Then, by employing a vision-language pretraining (VLP) model with the prompt engineering which has shown strong power in visual representation learning, the set of concepts is denoised according to the training images. Next, the proposed method UHSCM applies the VLP model with prompting again to mine the concept distribution of each image and construct a high-quality semantic similarity matrix based on the mined concept distributions. Finally, with the semantic similarity matrix as guiding information, a novel hashing loss with a modified contrastive loss based regularization item is proposed to optimize the hashing network. Extensive experiments on three benchmark datasets show that the proposed method outperforms the state-of-the-art baselines in the image retrieval task.

READ FULL TEXT

page 4

page 11

research
11/24/2018

Object Detection based Deep Unsupervised Hashing

Recently, similarity-preserving hashing methods have been extensively st...
research
10/15/2020

CIMON: Towards High-quality Hash Codes

Recently, hashing is widely-used in approximate nearest neighbor search ...
research
08/16/2021

Deep Self-Adaptive Hashing for Image Retrieval

Hashing technology has been widely used in image retrieval due to its co...
research
09/28/2022

Weighted Contrastive Hashing

The development of unsupervised hashing is advanced by the recent popula...
research
01/14/2022

ViT2Hash: Unsupervised Information-Preserving Hashing

Unsupervised image hashing, which maps images into binary codes without ...
research
03/17/2022

Deep Unsupervised Hashing with Latent Semantic Components

Deep unsupervised hashing has been appreciated in the regime of image re...
research
05/13/2021

Deep Unsupervised Hashing by Distilled Smooth Guidance

Hashing has been widely used in approximate nearest neighbor search for ...

Please sign up or login with your details

Forgot password? Click here to reset