MIA-Prognosis: A Deep Learning Framework to Predict Therapy Response

by   Jiancheng Yang, et al.

Predicting clinical outcome is remarkably important but challenging. Research efforts have been paid on seeking significant biomarkers associated with the therapy response or/and patient survival. However, these biomarkers are generally costly and invasive, and possibly dissatifactory for novel therapy. On the other hand, multi-modal, heterogeneous, unaligned temporal data is continuously generated in clinical practice. This paper aims at a unified deep learning approach to predict patient prognosis and therapy response, with easily accessible data, e.g., radiographics, laboratory and clinical information. Prior arts focus on modeling single data modality, or ignore the temporal changes. Importantly, the clinical time series is asynchronous in practice, i.e., recorded with irregular intervals. In this study, we formalize the prognosis modeling as a multi-modal asynchronous time series classification task, and propose a MIA-Prognosis framework with Measurement, Intervention and Assessment (MIA) information to predict therapy response, where a Simple Temporal Attention (SimTA) module is developed to process the asynchronous time series. Experiments on synthetic dataset validate the superiory of SimTA over standard RNN-based approaches. Furthermore, we experiment the proposed method on an in-house, retrospective dataset of real-world non-small cell lung cancer patients under anti-PD-1 immunotherapy. The proposed method achieves promising performance on predicting the immunotherapy response. Notably, our predictive model could further stratify low-risk and high-risk patients in terms of long-term survival.


page 1

page 2

page 3

page 4


Deep-CR MTLR: a Multi-Modal Approach for Cancer Survival Prediction with Competing Risks

Accurate survival prediction is crucial for development of precision can...

Multimodal Learning for Non-small Cell Lung Cancer Prognosis

This paper focuses on the task of survival time analysis for lung cancer...

Deep Biological Pathway Informed Pathology-Genomic Multimodal Survival Prediction

The integration of multi-modal data, such as pathological images and gen...

Predicting Treatment Initiation from Clinical Time Series Data via Graph-Augmented Time-Sensitive Model

Many computational models were proposed to extract temporal patterns fro...

Exploiting segmentation labels and representation learning to forecast therapy response of PDAC patients

The prediction of pancreatic ductal adenocarcinoma therapy response is a...

Deep learning prediction of patient response time course from early data via neural-pharmacokinetic/pharmacodynamic modeling

The longitudinal analysis of patient response time course following dose...

Please sign up or login with your details

Forgot password? Click here to reset