Whole Slide Images are 2D Point Clouds: Context-Aware Survival Prediction using Patch-based Graph Convolutional Networks

07/27/2021

∙

Cancer prognostication is a challenging task in computational pathology that requires context-aware representations of histology features to adequately infer patient survival. Despite the advancements made in weakly-supervised deep learning, many approaches are not context-aware and are unable to model important morphological feature interactions between cell identities and tissue types that are prognostic for patient survival. In this work, we present Patch-GCN, a context-aware, spatially-resolved patch-based graph convolutional network that hierarchically aggregates instance-level histology features to model local- and global-level topological structures in the tumor microenvironment. We validate Patch-GCN with 4,370 gigapixel WSIs across five different cancer types from the Cancer Genome Atlas (TCGA), and demonstrate that Patch-GCN outperforms all prior weakly-supervised approaches by 3.58-9.46 https://github.com/mahmoodlab/Patch-GCN.

READ FULL TEXT

Whole Slide Images are 2D Point Clouds: Context-Aware Survival Prediction using Patch-based Graph Convolutional Networks

Context-Aware Self-Supervised Learning of Whole Slide Images

HVTSurv: Hierarchical Vision Transformer for Patient-Level Survival Prediction from Whole Slide Image

Weakly Supervised Prostate TMA Classification via Graph Convolutional Networks

Weakly-Supervised Deep Learning Model for Prostate Cancer Diagnosis and Gleason Grading of Histopathology Images

Incorporating intratumoral heterogeneity into weakly-supervised deep learning models via variance pooling

Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Prediction

CGC-Net: Cell Graph Convolutional Network for Grading of Colorectal Cancer Histology Images

Whole Slide Images are 2D Point Clouds: Context-Aware Survival Prediction using Patch-based Graph Convolutional Networks

Related Research

Context-Aware Self-Supervised Learning of Whole Slide Images

HVTSurv: Hierarchical Vision Transformer for Patient-Level Survival Prediction from Whole Slide Image

Weakly Supervised Prostate TMA Classification via Graph Convolutional Networks

Weakly-Supervised Deep Learning Model for Prostate Cancer Diagnosis and Gleason Grading of Histopathology Images

Incorporating intratumoral heterogeneity into weakly-supervised deep learning models via variance pooling

Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Prediction

CGC-Net: Cell Graph Convolutional Network for Grading of Colorectal Cancer Histology Images