Log In Sign Up

Multimodal Learning for Cardiovascular Risk Prediction using EHR Data

by   Ayoub Bagheri, et al.

Electronic health records (EHRs) contain structured and unstructured data of significant clinical and research value. Various machine learning approaches have been developed to employ information in EHRs for risk prediction. The majority of these attempts, however, focus on structured EHR fields and lose the vast amount of information in the unstructured texts. To exploit the potential information captured in EHRs, in this study we propose a multimodal recurrent neural network model for cardiovascular risk prediction that integrates both medical texts and structured clinical information. The proposed multimodal bidirectional long short-term memory (BiLSTM) model concatenates word embeddings to classical clinical predictors before applying them to a final fully connected neural network. In the experiments, we compare performance of different deep neural network (DNN) architectures including convolutional neural network and long short-term memory in scenarios of using clinical variables and chest X-ray radiology reports. Evaluated on a data set of real world patients with manifest vascular disease or at high-risk for cardiovascular disease, the proposed BiLSTM model demonstrates state-of-the-art performance and outperforms other DNN baseline architectures.


page 4

page 6


A Dynamic Deep Neural Network For Multimodal Clinical Data Analysis

Clinical data from electronic medical records, registries or trials prov...

StageNet: Stage-Aware Neural Networks for Health Risk Prediction

Deep learning has demonstrated success in health risk prediction especia...

MeSIN: Multilevel Selective and Interactive Network for Medication Recommendation

Recommending medications for patients using electronic health records (E...

CNN-LSTM Based Multimodal MRI and Clinical Data Fusion for Predicting Functional Outcome in Stroke Patients

Clinical outcome prediction plays an important role in stroke patient ma...

Advancing PICO Element Detection in Medical Text via Deep Neural Networks

In evidence-based medicine (EBM), structured medical questions are alway...

Prediction of Chronic Kidney Disease Using Deep Neural Network

Deep neural Network (DNN) is becoming a focal point in Machine Learning ...