Hierarchical Cell-to-Tissue Graph Representations for Breast Cancer Subtyping in Digital Pathology

02/22/2021
by   Pushpak Pati, et al.
14

Cancer diagnosis and prognosis for a tissue specimen are heavily influenced by the phenotype and topological distribution of the constituting histological entities. Thus, adequate tissue representation by encoding the histological entities, and quantifying the relationship between the tissue representation and tissue functionality is imperative for computer aided cancer patient care. To this end, several approaches have leveraged cell-graphs, that encode cell morphology and organization, to denote the tissue information, and utilize graph theory and machine learning to map the representation to tissue functionality. Though cellular information is crucial, it is incomplete to comprehensively characterize the tissue. Therefore, we consider a tissue as a hierarchical composition of multiple types of histological entities from fine to coarse level, that depicts multivariate tissue information at multiple levels. We propose a novel hierarchical entity-graph representation to depict a tissue specimen, which encodes multiple pathologically relevant entity types, intra- and inter-level entity-to-entity interactions. Subsequently, a hierarchical graph neural network is proposed to operate on the entity-graph representation to map the tissue structure to tissue functionality. Specifically, we utilize cells and tissue regions in a tissue to build a HierArchical Cell-to-Tissue (HACT) graph representation, and HACT-Net, a graph neural network, to classify histology images. As part of this work, we propose the BReAst Carcinoma Subtyping (BRACS) dataset, a large cohort of Haematoxylin Eosin stained breast tumor regions-of-interest, to evaluate and benchmark our proposed methodology against pathologists and state-of-the-art computer-aided diagnostic approaches. Thorough comparative assessment and ablation studies demonstrated the superior classification efficacy of the proposed methodology.

READ FULL TEXT

page 1

page 5

page 6

page 8

page 12

research
07/01/2020

HACT-Net: A Hierarchical Cell-to-Tissue Graph Neural Network for Histopathological Image Classification

Cancer diagnosis, prognosis, and therapeutic response prediction are hea...
research
07/21/2021

HistoCartography: A Toolkit for Graph Analytics in Digital Pathology

Advances in entity-graph based analysis of histopathology images have br...
research
10/10/2021

Scope2Screen: Focus+Context Techniques for Pathology Tumor Assessment in Multivariate Image Data

Inspection of tissues using a light microscope is the primary method of ...
research
07/01/2021

A Survey on Graph-Based Deep Learning for Computational Histopathology

With the remarkable success of representation learning for prediction pr...
research
07/01/2020

Towards Explainable Graph Representations in Digital Pathology

Explainability of machine learning (ML) techniques in digital pathology ...
research
02/01/2022

A Graph Based Neural Network Approach to Immune Profiling of Multiplexed Tissue Samples

Multiplexed immunofluorescence provides an unprecedented opportunity for...
research
11/25/2020

Quantifying Explainers of Graph Neural Networks in Computational Pathology

Explainability of deep learning methods is imperative to facilitate thei...

Please sign up or login with your details

Forgot password? Click here to reset