Automatic Breast Lesion Classification by Joint Neural Analysis of Mammography and Ultrasound

09/23/2020
by   Gavriel Habib, et al.
0

Mammography and ultrasound are extensively used by radiologists as complementary modalities to achieve better performance in breast cancer diagnosis. However, existing computer-aided diagnosis (CAD) systems for the breast are generally based on a single modality. In this work, we propose a deep-learning based method for classifying breast cancer lesions from their respective mammography and ultrasound images. We present various approaches and show a consistent improvement in performance when utilizing both modalities. The proposed approach is based on a GoogleNet architecture, fine-tuned for our data in two training steps. First, a distinct neural network is trained separately for each modality, generating high-level features. Then, the aggregated features originating from each modality are used to train a multimodal network to provide the final classification. In quantitative experiments, the proposed approach achieves an AUC of 0.94, outperforming state-of-the-art models trained over a single modality. Moreover, it performs similarly to an average radiologist, surpassing two out of four radiologists participating in a reader study. The promising results suggest that the proposed method may become a valuable decision support tool for breast radiologists.

READ FULL TEXT

page 4

page 8

08/08/2020

Auto-weighting for Breast Cancer Classification in Multimodal Ultrasound

Breast cancer is the most common invasive cancer in women. Besides the p...
05/02/2022

MIRST-DM: Multi-Instance RST with Drop-Max Layer for Robust Classification of Breast Cancer

Robust self-training (RST) can augment the adversarial robustness of ima...
01/13/2022

EMT-NET: Efficient multitask network for computer-aided diagnosis of breast cancer

Deep learning-based computer-aided diagnosis has achieved unprecedented ...
02/17/2021

Ensemble Transfer Learning of Elastography and B-mode Breast Ultrasound Images

Computer-aided detection (CAD) of benign and malignant breast lesions be...
08/09/2021

Explainable AI and susceptibility to adversarial attacks: a case study in classification of breast ultrasound images

Ultrasound is a non-invasive imaging modality that can be conveniently u...
07/12/2021

Learned super resolution ultrasound for improved breast lesion characterization

Breast cancer is the most common malignancy in women. Mammographic findi...