DeepAI AI Chat
Log In Sign Up

A Multimodal Transformer: Fusing Clinical Notes with Structured EHR Data for Interpretable In-Hospital Mortality Prediction

by   Weimin Lyu, et al.

Deep-learning-based clinical decision support using structured electronic health records (EHR) has been an active research area for predicting risks of mortality and diseases. Meanwhile, large amounts of narrative clinical notes provide complementary information, but are often not integrated into predictive models. In this paper, we provide a novel multimodal transformer to fuse clinical notes and structured EHR data for better prediction of in-hospital mortality. To improve interpretability, we propose an integrated gradients (IG) method to select important words in clinical notes and discover the critical structured EHR features with Shapley values. These important words and clinical features are visualized to assist with interpretation of the prediction outcomes. We also investigate the significance of domain adaptive pretraining and task adaptive fine-tuning on the Clinical BERT, which is used to learn the representations of clinical notes. Experiments demonstrated that our model outperforms other methods (AUCPR: 0.538, AUCROC: 0.877, F1:0.490).


Characterizing the Value of Information in Medical Notes

Machine learning models depend on the quality of input data. As electron...

Mortality Prediction Models with Clinical Notes Using Sparse Attention at the Word and Sentence Levels

Intensive Care in-hospital mortality prediction has various clinical app...

Rationale production to support clinical decision-making

The development of neural networks for clinical artificial intelligence ...

Multimodal Ensemble Approach to Incorporate Various Types of Clinical Notes for Predicting Readmission

Electronic Health Records (EHRs) have been heavily used to predict vario...

Dynamically Extracting Outcome-Specific Problem Lists from Clinical Notes with Guided Multi-Headed Attention

Problem lists are intended to provide clinicians with a relevant summary...

Ensemble model for pre-discharge icd10 coding prediction

The translation of medical diagnosis to clinical coding has wide range o...