Act Like a Radiologist: Towards Reliable Multi-view Correspondence Reasoning for Mammogram Mass Detection

05/21/2021
by   Yuhang Liu, et al.
11

Mammogram mass detection is crucial for diagnosing and preventing the breast cancers in clinical practice. The complementary effect of multi-view mammogram images provides valuable information about the breast anatomical prior structure and is of great significance in digital mammography interpretation. However, unlike radiologists who can utilize the natural reasoning ability to identify masses based on multiple mammographic views, how to endow the existing object detection models with the capability of multi-view reasoning is vital for decision-making in clinical diagnosis but remains the boundary to explore. In this paper, we propose an Anatomy-aware Graph convolutional Network (AGN), which is tailored for mammogram mass detection and endows existing detection methods with multi-view reasoning ability. The proposed AGN consists of three steps. Firstly, we introduce a Bipartite Graph convolutional Network (BGN) to model the intrinsic geometric and semantic relations of ipsilateral views. Secondly, considering that the visual asymmetry of bilateral views is widely adopted in clinical practice to assist the diagnosis of breast lesions, we propose an Inception Graph convolutional Network (IGN) to model the structural similarities of bilateral views. Finally, based on the constructed graphs, the multi-view information is propagated through nodes methodically, which equips the features learned from the examined view with multi-view reasoning ability. Experiments on two standard benchmarks reveal that AGN significantly exceeds the state-of-the-art performance. Visualization results show that AGN provides interpretable visual cues for clinical diagnosis.

READ FULL TEXT

page 3

page 5

page 6

page 11

page 15

research
08/11/2023

M M: Tackling False Positives in Mammography with a Multi-view and Multi-instance Learning Sparse Detector

Deep-learning-based object detection methods show promise for improving ...
research
07/01/2019

Cross-view Relation Networks for Mammogram Mass Detection

Mammogram is the most effective imaging modality for the mass lesion det...
research
03/19/2018

A Mixture of Views Network with Applications to the Classification of Breast Microcalcifications

In this paper we examine data fusion methods for multi-view data classif...
research
07/31/2023

Multi-Spectral Image Stitching via Spatial Graph Reasoning

Multi-spectral image stitching leverages the complementarity between inf...
research
11/16/2022

Learnable Graph Convolutional Network and Feature Fusion for Multi-view Learning

In practical applications, multi-view data depicting objectives from ass...
research
08/27/2019

HRGE-Net: Hierarchical Relational Graph Embedding Network for Multi-view 3D Shape Recognition

View-based approach that recognizes 3D shape through its projected 2D im...
research
07/01/2022

Personalized Diagnostic Tool for Thyroid Cancer Classification using Multi-view Ultrasound

Over the past decades, the incidence of thyroid cancer has been increasi...

Please sign up or login with your details

Forgot password? Click here to reset