NaroNet: Objective-based learning of the tumor microenvironment from highly multiplexed immunostained images

03/09/2021
by   Daniel Jiménez-Sánchez, et al.
0

We present NaroNet, a Machine Learning framework that integrates the multiscale spatial, in situ analysis of the tumor microenvironment (TME) with patient-level predictions into a seamless end-to-end learning pipeline. Trained only with patient-level labels, NaroNet quantifies the phenotypes, neighborhoods, and neighborhood interactions that have the highest influence on the predictive task. We validate NaroNet using synthetic data simulating multiplex-immunostained images with adjustable probabilistic incidence of different TMEs. Then we apply our model to two real sets of patient tumors, one consisting of 336 seven-color multiplex-immunostained images from 12 high-grade endometrial cancers, and the other consisting of 372 35-plex mass cytometry images from 283 breast cancer patients. In both synthetic and real datasets, NaroNet provides outstanding predictions while associating those predictions to the presence of specific TMEs. This inherent interpretability could be of great value both in a clinical setting and as a tool to discover novel biomarker signatures.

READ FULL TEXT

page 5

page 10

page 12

page 37

page 38

page 39

page 40

page 41

research
07/20/2018

Knowledge Integration for Disease Characterization: A Breast Cancer Example

With the rapid advancements in cancer research, the information that is ...
research
07/24/2017

Automatic breast cancer grading in lymph nodes using a deep neural network

The progression of breast cancer can be quantified in lymph node whole-s...
research
06/13/2018

Multiple Instance Learning for Heterogeneous Images: Training a CNN for Histopathology

Multiple instance (MI) learning with a convolutional neural network enab...
research
06/30/2022

End-to-end Learning for Image-based Detection of Molecular Alterations in Digital Pathology

Current approaches for classification of whole slide images (WSI) in dig...
research
10/25/2018

Radiomic Synthesis Using Deep Convolutional Neural Networks

Radiomics is a rapidly growing field that deals with modeling the textur...

Please sign up or login with your details

Forgot password? Click here to reset