Deep Cross-modal Proxy Hashing

11/06/2020
by   Rong-Cheng Tu, et al.
0

Due to their high retrieval efficiency and low storage cost for cross-modal search task, cross-modal hashing methods have attracted considerable attention. For supervised cross-modal hashing methods, how to make the learned hash codes preserve semantic structure information sufficiently is a key point to further enhance the retrieval performance. As far as we know, almost all supervised cross-modal hashing methods preserve semantic structure information depending on at-least-one similarity definition fully or partly, i.e., it defines two datapoints as similar ones if they share at least one common category otherwise they are dissimilar. Obviously, the at-least-one similarity misses abundant semantic structure information. To tackle this problem, in this paper, we propose a novel Deep Cross-modal Proxy Hashing, called DCPH. Specifically, DCPH first learns a proxy hashing network to generate a discriminative proxy hash code for each category. Then, by utilizing the learned proxy hash code as supervised information, a novel Margin-SoftMax-like loss is proposed without defining the at-least-one similarity between datapoints. By minimizing the novel Margin-SoftMax-like loss, the learned hash codes will simultaneously preserve the cross-modal similarity and abundant semantic structure information well. Extensive experiments on two benchmark datasets show that the proposed method outperforms the state-of-the-art baselines in cross-modal retrieval task.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/04/2019

Triplet-Based Deep Hashing Network for Cross-Modal Retrieval

Given the benefits of its low storage requirements and high retrieval ef...
research
07/29/2019

Deep Cross-Modal Hashing with Hashing Functions and Unified Hash Codes Jointly Learning

Due to their high retrieval efficiency and low storage cost, cross-modal...
research
02/07/2020

Deep Robust Multilevel Semantic Cross-Modal Hashing

Hashing based cross-modal retrieval has recently made significant progre...
research
07/27/2020

Deep Hashing with Hash-Consistent Large Margin Proxy Embeddings

Image hash codes are produced by binarizing the embeddings of convolutio...
research
12/06/2018

Discriminative Supervised Hashing for Cross-Modal similarity Search

With the advantage of low storage cost and high retrieval efficiency, ha...
research
04/26/2023

Deep Lifelong Cross-modal Hashing

Hashing methods have made significant progress in cross-modal retrieval ...
research
02/02/2019

Joint Cluster Unary Loss for Efficient Cross-Modal Hashing

With the rapid growth of various types of multimodal data, cross-modal d...

Please sign up or login with your details

Forgot password? Click here to reset