Self-Supervised Adversarial Hashing Networks for Cross-Modal Retrieval

04/04/2018
by   Chao Li, et al.
0

Thanks to the success of deep learning, cross-modal retrieval has made significant progress recently. However, there still remains a crucial bottleneck: how to bridge the modality gap to further enhance the retrieval accuracy. In this paper, we propose a self-supervised adversarial hashing (SSAH) approach, which lies among the early attempts to incorporate adversarial learning into cross-modal hashing in a self-supervised fashion. The primary contribution of this work is that two adversarial networks are leveraged to maximize the semantic correlation and consistency of the representations between different modalities. In addition, we harness a self-supervised semantic network to discover high-level semantic information in the form of multi-label annotations. Such information guides the feature learning process and preserves the modality relationships in both the common semantic space and the Hamming space. Extensive experiments carried out on three benchmark datasets validate that the proposed SSAH surpasses the state-of-the-art methods.

READ FULL TEXT
research
04/25/2019

Fusion-supervised Deep Cross-modal Hashing

Deep hashing has recently received attention in cross-modal retrieval fo...
research
12/01/2017

Unsupervised Generative Adversarial Cross-modal Hashing

Cross-modal hashing aims to map heterogeneous multimedia data into a com...
research
12/07/2020

Self-supervised asymmetric deep hashing with margin-scalable constraint for image retrieval

Due to its validity and rapidity, image retrieval based on deep hashing ...
research
07/19/2022

Learning Mutual Modulation for Self-Supervised Cross-Modal Super-Resolution

Self-supervised cross-modal super-resolution (SR) can overcome the diffi...
research
03/10/2021

Cross-modal Image Retrieval with Deep Mutual Information Maximization

In this paper, we study the cross-modal image retrieval, where the input...
research
03/25/2021

Discriminative Semantic Transitive Consistency for Cross-Modal Learning

Cross-modal retrieval is generally performed by projecting and aligning ...
research
04/11/2021

Integrating Information Theory and Adversarial Learning for Cross-modal Retrieval

Accurately matching visual and textual data in cross-modal retrieval has...

Please sign up or login with your details

Forgot password? Click here to reset