DeepAI AI Chat
Log In Sign Up

Deep Biological Pathway Informed Pathology-Genomic Multimodal Survival Prediction

by   Lin Qiu, et al.

The integration of multi-modal data, such as pathological images and genomic data, is essential for understanding cancer heterogeneity and complexity for personalized treatments, as well as for enhancing survival predictions. Despite the progress made in integrating pathology and genomic data, most existing methods cannot mine the complex inter-modality relations thoroughly. Additionally, identifying explainable features from these models that govern preclinical discovery and clinical prediction is crucial for cancer diagnosis, prognosis, and therapeutic response studies. We propose PONET- a novel biological pathway-informed pathology-genomic deep model that integrates pathological images and genomic data not only to improve survival prediction but also to identify genes and pathways that cause different survival rates in patients. Empirical results on six of The Cancer Genome Atlas (TCGA) datasets show that our proposed method achieves superior predictive performance and reveals meaningful biological interpretations. The proposed method establishes insight into how to train biologically informed deep networks on multimodal biomedical data which will have general applicability for understanding diseases and predicting response and resistance to treatment.


page 16

page 18

page 19

page 20

page 21

page 22


Deep-CR MTLR: a Multi-Modal Approach for Cancer Survival Prediction with Competing Risks

Accurate survival prediction is crucial for development of precision can...

Stacked Autoencoder Based Multi-Omics Data Integration for Cancer Survival Prediction

Cancer survival prediction is important for developing personalized trea...

Incorporating intratumoral heterogeneity into weakly-supervised deep learning models via variance pooling

Supervised learning tasks such as cancer survival prediction from gigapi...

Explainable Censored Learning: Finding Critical Features with Long Term Prognostic Values for Survival Prediction

Interpreting critical variables involved in complex biological processes...

MIA-Prognosis: A Deep Learning Framework to Predict Therapy Response

Predicting clinical outcome is remarkably important but challenging. Res...

Metareview-informed Explainable Cytokine Storm Detection during CAR-T cell Therapy

Cytokine release syndrome (CRS), also known as cytokine storm, is one of...