Multi-Scale Attention-based Multiple Instance Learning for Classification of Multi-Gigapixel Histology Images

09/07/2022

∙

Histology images with multi-gigapixel of resolution yield rich information for cancer diagnosis and prognosis. Most of the time, only slide-level label is available because pixel-wise annotation is labour intensive task. In this paper, we propose a deep learning pipeline for classification in histology images. Using multiple instance learning, we attempt to predict the latent membrane protein 1 (LMP1) status of nasopharyngeal carcinoma (NPC) based on haematoxylin and eosin-stain (H E) histology images. We utilised attention mechanism with residual connection for our aggregation layers. In our 3-fold cross-validation experiment, we achieved average accuracy, AUC and F1-score 0.936, 0.995 and 0.862, respectively. This method also allows us to examine the model interpretability by visualising attention scores. To the best of our knowledge, this is the first attempt to predict LMP1 status on NPC using deep learning.

READ FULL TEXT

Multi-Scale Attention-based Multiple Instance Learning for Classification of Multi-Gigapixel Histology Images

Cross-scale Attention Guided Multi-instance Learning for Crohn's Disease Diagnosis with Pathological Images

Efficient subtyping of ovarian cancer histopathology whole slide images using active sampling in multiple instance learning

Classifying bacteria clones using attention-based deep multiple instance learning interpreted by persistence homology

Computer-aided diagnosis in histopathological images of the endometrium using a convolutional neural network and attention mechanisms

Multi-Stain Self-Attention Graph Multiple Instance Learning Pipeline for Histopathology Whole Slide Images

Terabyte-scale Deep Multiple Instance Learning for Classification and Localization in Pathology

Bayesian aggregation improves traditional single image crop classification approaches

Code Repositories

MultiAttentionMIL

Multi-Scale Attention-based Multiple Instance Learning for Classification of Multi-Gigapixel Histology Images

Related Research

Cross-scale Attention Guided Multi-instance Learning for Crohn's Disease Diagnosis with Pathological Images

Efficient subtyping of ovarian cancer histopathology whole slide images using active sampling in multiple instance learning

Classifying bacteria clones using attention-based deep multiple instance learning interpreted by persistence homology

Computer-aided diagnosis in histopathological images of the endometrium using a convolutional neural network and attention mechanisms

Multi-Stain Self-Attention Graph Multiple Instance Learning Pipeline for Histopathology Whole Slide Images

Terabyte-scale Deep Multiple Instance Learning for Classification and Localization in Pathology

Bayesian aggregation improves traditional single image crop classification approaches

Code Repositories

MultiAttentionMIL