Incorporating intratumoral heterogeneity into weakly-supervised deep learning models via variance pooling

06/17/2022
by   Iain Carmichael, et al.
0

Supervised learning tasks such as cancer survival prediction from gigapixel whole slide images (WSIs) are a critical challenge in computational pathology that requires modeling complex features of the tumor microenvironment. These learning tasks are often solved with deep multi-instance learning (MIL) models that do not explicitly capture intratumoral heterogeneity. We develop a novel variance pooling architecture that enables a MIL model to incorporate intratumoral heterogeneity into its predictions. Two interpretability tools based on representative patches are illustrated to probe the biological signals captured by these models. An empirical study with 4,479 gigapixel WSIs from the Cancer Genome Atlas shows that adding variance pooling onto MIL frameworks improves survival prediction performance for five cancer types.

READ FULL TEXT

page 8

page 12

research
03/31/2022

Optimize Deep Learning Models for Prediction of Gene Mutations Using Unsupervised Clustering

Deep learning has become the mainstream methodological choice for analyz...
research
01/06/2023

Deep Biological Pathway Informed Pathology-Genomic Multimodal Survival Prediction

The integration of multi-modal data, such as pathological images and gen...
research
05/09/2023

CAMIL: Context-Aware Multiple Instance Learning for Whole Slide Image Classification

Cancer diagnoses typically involve human pathologists examining whole sl...
research
07/27/2021

Whole Slide Images are 2D Point Clouds: Context-Aware Survival Prediction using Patch-based Graph Convolutional Networks

Cancer prognostication is a challenging task in computational pathology ...
research
10/22/2021

MHAttnSurv: Multi-Head Attention for Survival Prediction Using Whole-Slide Pathology Images

In pathology, whole-slide images (WSI) based survival prediction has att...
research
07/08/2022

Stacked Autoencoder Based Multi-Omics Data Integration for Cancer Survival Prediction

Cancer survival prediction is important for developing personalized trea...
research
07/05/2013

Supervised Learning and Anti-learning of Colorectal Cancer Classes and Survival Rates from Cellular Biology Parameters

In this paper, we describe a dataset relating to cellular and physical c...

Please sign up or login with your details

Forgot password? Click here to reset