CAMIL: Context-Aware Multiple Instance Learning for Whole Slide Image Classification

05/09/2023
by   Olga Fourkioti, et al.
0

Cancer diagnoses typically involve human pathologists examining whole slide images (WSIs) of tissue section biopsies to identify tumor cells and their subtypes. However, artificial intelligence (AI)-based models, particularly weakly supervised approaches, have recently emerged as viable alternatives. Weakly supervised approaches often use image subsections or tiles as input, with the overall classification of the WSI based on attention scores assigned to each tile. However, this method overlooks the potential for false positives/negatives because tumors can be heterogeneous, with cancer and normal cells growing in patterns larger than a single tile. Such errors at the tile level could lead to misclassification at the tumor level. To address this limitation, we developed a novel deep learning pooling operator called CHARM (Contrastive Histopathology Attention Resolved Models). CHARM leverages the dependencies among single tiles within a WSI and imposes contextual constraints as prior knowledge to multiple instance learning models. We tested CHARM on the subtyping of non-small cell lung cancer (NSLC) and lymph node (LN) metastasis, and the results demonstrated its superiority over other state-of-the-art weakly supervised classification algorithms. Furthermore, CHARM facilitates interpretability by visualizing regions of attention.

READ FULL TEXT

page 4

page 9

page 10

page 11

research
08/29/2023

RACR-MIL: Weakly Supervised Skin Cancer Grading using Rank-Aware Contextual Reasoning on Whole Slide Images

Cutaneous squamous cell cancer (cSCC) is the second most common skin can...
research
10/29/2019

Weakly Supervised Prostate TMA Classification via Graph Convolutional Networks

Histology-based grade classification is clinically important for many ca...
research
07/12/2023

The Whole Pathological Slide Classification via Weakly Supervised Learning

Due to its superior efficiency in utilizing annotations and addressing g...
research
09/07/2023

Beyond attention: deriving biologically interpretable insights from weakly-supervised multiple-instance learning models

Recent advances in attention-based multiple instance learning (MIL) have...
research
06/17/2022

Incorporating intratumoral heterogeneity into weakly-supervised deep learning models via variance pooling

Supervised learning tasks such as cancer survival prediction from gigapi...
research
04/11/2023

Regression-based Deep-Learning predicts molecular biomarkers from pathology slides

Deep Learning (DL) can predict biomarkers from cancer histopathology. Se...
research
03/02/2023

Active Learning Enhances Classification of Histopathology Whole Slide Images with Attention-based Multiple Instance Learning

In many histopathology tasks, sample classification depends on morpholog...

Please sign up or login with your details

Forgot password? Click here to reset