Attention-based Saliency Hashing for Ophthalmic Image Retrieval

by   Jiansheng Fang, et al.

Deep hashing methods have been proved to be effective for the large-scale medical image search assisting reference-based diagnosis for clinicians. However, when the salient region plays a maximal discriminative role in ophthalmic image, existing deep hashing methods do not fully exploit the learning ability of the deep network to capture the features of salient regions pointedly. The different grades or classes of ophthalmic images may be share similar overall performance but have subtle differences that can be differentiated by mining salient regions. To address this issue, we propose a novel end-to-end network, named Attention-based Saliency Hashing (ASH), for learning compact hash-code to represent ophthalmic images. ASH embeds a spatial-attention module to focus more on the representation of salient regions and highlights their essential role in differentiating ophthalmic images. Benefiting from the spatial-attention module, the information of salient regions can be mapped into the hash-code for similarity calculation. In the training stage, we input the image pairs to share the weights of the network, and a pairwise loss is designed to maximize the discriminability of the hash-code. In the retrieval stage, ASH obtains the hash-code by inputting an image with an end-to-end manner, then the hash-code is used to similarity calculation to return the most similar images. Extensive experiments on two different modalities of ophthalmic image datasets demonstrate that the proposed ASH can further improve the retrieval performance compared to the state-of-the-art deep hashing methods due to the huge contributions of the spatial-attention module.


page 1

page 2

page 4

page 7


Deep Triplet Hashing Network for Case-based Medical Image Retrieval

Deep hashing methods have been shown to be the most efficient approximat...

Deep Saliency Hashing

In recent years, hashing methods have been proved efficient for large-sc...

Combating Ambiguity for Hash-code Learning in Medical Instance Retrieval

When encountering a dubious diagnostic case, medical instance retrieval ...

Invariant Spectral Hashing of Image Saliency Graph

Image hashing is the process of associating a short vector of bits to an...

A Feature Consistency Driven Attention Erasing Network for Fine-Grained Image Retrieval

Large-scale fine-grained image retrieval has two main problems. First, l...

Regularizing Deep Hashing Networks Using GAN Generated Fake Images

Recently, deep-networks-based hashing (deep hashing) has become a leadin...

Vision Transformer Based Video Hashing Retrieval for Tracing the Source of Fake Videos

Conventional fake video detection methods outputs a possibility value or...

Please sign up or login with your details

Forgot password? Click here to reset