Similar Image Search for Histopathology: SMILY

01/30/2019
by   Narayan Hegde, et al.
0

The increasing availability of large institutional and public histopathology image datasets is enabling the searching of these datasets for diagnosis, research, and education. Though these datasets typically have associated metadata such as diagnosis or clinical notes, even carefully curated datasets rarely contain annotations of the location of regions of interest on each image. Because pathology images are extremely large (up to 100,000 pixels in each dimension), further laborious visual search of each image may be needed to find the feature of interest. In this paper, we introduce a deep learning based reverse image search tool for histopathology images: Similar Medical Images Like Yours (SMILY). We assessed SMILY's ability to retrieve search results in two ways: using pathologist-provided annotations, and via prospective studies where pathologists evaluated the quality of SMILY search results. As a negative control in the second evaluation, pathologists were blinded to whether search results were retrieved by SMILY or randomly. In both types of assessments, SMILY was able to retrieve search results with similar histologic features, organ site, and prostate cancer Gleason grade compared with the original query. SMILY may be a useful general-purpose tool in the pathologist's arsenal, to improve the efficiency of searching large archives of histopathology images, without the need to develop and implement specific tools for each application.

READ FULL TEXT

page 11

page 12

page 24

page 26

research
09/27/2017

Combining Real-Valued and Binary Gabor-Radon Features for Classification and Search in Medical Imaging Archives

Content-based image retrieval (CBIR) of medical images in large datasets...
research
07/28/2021

Fast and Scalable Image Search For Histology

The expanding adoption of digital pathology has enabled the curation of ...
research
11/20/2019

Yottixel – An Image Search Engine for Large Archives of Histopathology Whole Slide Images

With the emergence of digital pathology, searching for similar images in...
research
04/24/2023

Composite Biomarker Image for Advanced Visualization in Histopathology

Immunohistochemistry (IHC) biomarkers are essential tools for reliable c...
research
06/27/2023

Dental CLAIRES: Contrastive LAnguage Image REtrieval Search for Dental Research

Learning about diagnostic features and related clinical information from...
research
11/20/2019

Pan-Cancer Diagnostic Consensus Through Searching Archival Histopathology Images Using Artificial Intelligence

The emergence of digital pathology has opened new horizons for histopath...
research
04/24/2023

Immunohistochemistry Biomarkers-Guided Image Search for Histopathology

Medical practitioners use a number of diagnostic tests to make a reliabl...

Please sign up or login with your details

Forgot password? Click here to reset