Automatic Breast Lesion Classification by Joint Neural Analysis of Mammography and Ultrasound

09/23/2020
by   Gavriel Habib, et al.
0

Mammography and ultrasound are extensively used by radiologists as complementary modalities to achieve better performance in breast cancer diagnosis. However, existing computer-aided diagnosis (CAD) systems for the breast are generally based on a single modality. In this work, we propose a deep-learning based method for classifying breast cancer lesions from their respective mammography and ultrasound images. We present various approaches and show a consistent improvement in performance when utilizing both modalities. The proposed approach is based on a GoogleNet architecture, fine-tuned for our data in two training steps. First, a distinct neural network is trained separately for each modality, generating high-level features. Then, the aggregated features originating from each modality are used to train a multimodal network to provide the final classification. In quantitative experiments, the proposed approach achieves an AUC of 0.94, outperforming state-of-the-art models trained over a single modality. Moreover, it performs similarly to an average radiologist, surpassing two out of four radiologists participating in a reader study. The promising results suggest that the proposed method may become a valuable decision support tool for breast radiologists.

READ FULL TEXT

page 4

page 8

research
02/27/2020

Joint 2D-3D Breast Cancer Classification

Breast cancer is the malignant tumor that causes the highest number of c...
research
08/19/2023

Breast Lesion Diagnosis Using Static Images and Dynamic Video

Deep learning based Computer Aided Diagnosis (CAD) systems have been dev...
research
08/08/2020

Auto-weighting for Breast Cancer Classification in Multimodal Ultrasound

Breast cancer is the most common invasive cancer in women. Besides the p...
research
05/02/2022

MIRST-DM: Multi-Instance RST with Drop-Max Layer for Robust Classification of Breast Cancer

Robust self-training (RST) can augment the adversarial robustness of ima...
research
05/27/2020

An ENAS Based Approach for Constructing Deep Learning Models for Breast Cancer Recognition from Ultrasound Images

Deep Convolutional Neural Networks (CNN) provides an "end-to-end" soluti...
research
08/09/2021

Explainable AI and susceptibility to adversarial attacks: a case study in classification of breast ultrasound images

Ultrasound is a non-invasive imaging modality that can be conveniently u...
research
07/12/2021

Learned super resolution ultrasound for improved breast lesion characterization

Breast cancer is the most common malignancy in women. Mammographic findi...

Please sign up or login with your details

Forgot password? Click here to reset