Decomposing Normal and Abnormal Features of Medical Images into Discrete Latent Codes for Content-Based Image Retrieval

03/23/2021
by   Kazuma Kobayashi, et al.
0

In medical imaging, the characteristics purely derived from a disease should reflect the extent to which abnormal findings deviate from the normal features. Indeed, physicians often need corresponding images without abnormal findings of interest or, conversely, images that contain similar abnormal findings regardless of normal anatomical context. This is called comparative diagnostic reading of medical images, which is essential for a correct diagnosis. To support comparative diagnostic reading, content-based image retrieval (CBIR), which can selectively utilize normal and abnormal features in medical images as two separable semantic components, will be useful. Therefore, we propose a neural network architecture to decompose the semantic components of medical images into two latent codes: normal anatomy code and abnormal anatomy code. The normal anatomy code represents normal anatomies that should have existed if the sample is healthy, whereas the abnormal anatomy code attributes to abnormal changes that reflect deviation from the normal baseline. These latent codes are discretized through vector quantization to enable binary hashing, which can reduce the computational burden at the time of similarity search. By calculating the similarity based on either normal or abnormal anatomy codes or the combination of the two codes, our algorithm can retrieve images according to the selected semantic component from a dataset consisting of brain magnetic resonance images of gliomas. Our CBIR system qualitatively and quantitatively achieves remarkable results.

READ FULL TEXT

page 2

page 5

page 8

page 12

page 13

page 14

page 16

research
11/12/2020

Decomposing Normal and Abnormal Features of Medical Images for Content-based Image Retrieval

Medical images can be decomposed into normal and abnormal features, whic...
research
03/07/2023

Sketch-based Medical Image Retrieval

The amount of medical images stored in hospitals is increasing faster th...
research
09/27/2017

Combining Real-Valued and Binary Gabor-Radon Features for Classification and Search in Medical Imaging Archives

Content-based image retrieval (CBIR) of medical images in large datasets...
research
12/04/2019

Efficient feature embedding of 3D brain MRI images for content-based image retrieval with deep metric learning

Increasing numbers of MRI brain scans, improvements in image resolution,...
research
12/22/2000

Creativity and Delusions: A Neurocomputational Approach

Thinking is one of the most interesting mental processes. Its complexity...
research
12/03/2017

Triagem virtual de imagens de imuno-histoquímica usando redes neurais artificiais e espectro de padrões

The importance of organizing medical images according to their nature, a...
research
05/19/2021

Combating Ambiguity for Hash-code Learning in Medical Instance Retrieval

When encountering a dubious diagnostic case, medical instance retrieval ...

Please sign up or login with your details

Forgot password? Click here to reset