Case-based similar image retrieval for weakly annotated large histopathological images of malignant lymphoma using deep metric learning

07/08/2021
by   Noriaki Hashimoto, et al.
0

In the present study, we propose a novel case-based similar image retrieval (SIR) method for hematoxylin and eosin (H E)-stained histopathological images of malignant lymphoma. When a whole slide image (WSI) is used as an input query, it is desirable to be able to retrieve similar cases by focusing on image patches in pathologically important regions such as tumor cells. To address this problem, we employ attention-based multiple instance learning, which enables us to focus on tumor-specific regions when the similarity between cases is computed. Moreover, we employ contrastive distance metric learning to incorporate immunohistochemical (IHC) staining patterns as useful supervised information for defining appropriate similarity between heterogeneous malignant lymphoma cases. In the experiment with 249 malignant lymphoma patients, we confirmed that the proposed method exhibited higher evaluation measures than the baseline case-based SIR methods. Furthermore, the subjective evaluation by pathologists revealed that our similarity measure using IHC staining patterns is appropriate for representing the similarity of H E-stained tissue images for malignant lymphoma.

READ FULL TEXT

page 4

page 18

page 19

page 21

research
10/04/2022

Supervised Metric Learning for Retrieval via Contextual Similarity Optimization

Existing deep metric learning approaches fall into three general categor...
research
10/22/2018

Brain Tumor Image Retrieval via Multitask Learning

Classification-based image retrieval systems are built by training convo...
research
04/07/2013

Image Retrieval using Histogram Factorization and Contextual Similarity Learning

Image retrieval has been a top topic in the field of both computer visio...
research
05/09/2023

Region-based Contrastive Pretraining for Medical Image Retrieval with Anatomic Query

We introduce a novel Region-based contrastive pretraining for Medical Im...
research
05/29/2019

Approaching Adaptation Guided Retrieval in Case-Based Reasoning through Inference in Undirected Graphical Models

In Case-Based Reasoning, when the similarity assumption does not hold, t...
research
11/16/2020

A New Similarity Space Tailored for Supervised Deep Metric Learning

We propose a novel deep metric learning method. Differently from many wo...
research
11/11/2019

Part-based Multi-stream Model for Vehicle Searching

Due to the enormous requirement in public security and intelligent trans...

Please sign up or login with your details

Forgot password? Click here to reset