Graph Convolutional Transformer: Learning the Graphical Structure of Electronic Health Records

by   Edward Choi, et al.

Effective modeling of electronic health records (EHR) is rapidly becoming an important topic in both academia and industry. A recent study showed that utilizing the graphical structure underlying EHR data (e.g. relationship between diagnoses and treatments) improves the performance of prediction tasks such as heart failure diagnosis prediction. However, EHR data do not always contain complete structure information. Moreover, when it comes to claims data, structure information is completely unavailable to begin with. Under such circumstances, can we still do better than just treating EHR data as a flat-structured bag-of-features? In this paper, we study the possibility of utilizing the implicit structure of EHR by using the Transformer for prediction tasks on EHR data. Specifically, we argue that the Transformer is a suitable model to learn the hidden EHR structure, and propose the Graph Convolutional Transformer, which uses data statistics to guide the structure learning process. Our model empirically demonstrated superior prediction performance to previous approaches on both synthetic data and publicly available EHR data on encounter-based prediction tasks such as graph reconstruction and readmission prediction, indicating that it can serve as an effective general-purpose representation learning algorithm for EHR data.


Multi Layered-Parallel Graph Convolutional Network (ML-PGCN) for Disease Prediction

Structural data from Electronic Health Records as complementary informat...

TAPER: Time-Aware Patient EHR Representation

Effective representation learning of electronic health records is a chal...

Self-supervised Representation Learning on Electronic Health Records with Graph Kernel Infomax

Learning Electronic Health Records (EHRs) representation is a preeminent...

Hierarchical Target-Attentive Diagnosis Prediction in Heterogeneous Information Networks

We introduce HTAD, a novel model for diagnosis prediction using Electron...

MUFASA: Multimodal Fusion Architecture Search for Electronic Health Records

One important challenge of applying deep learning to electronic health r...

MiME: Multilevel Medical Embedding of Electronic Health Records for Predictive Healthcare

Deep learning models exhibit state-of-the-art performance for many predi...

Knowledge Graph Embedding with Electronic Health Records Data via Latent Graphical Block Model

Due to the increasing adoption of electronic health records (EHR), large...

Code Repositories


Graph Convolutional Transformer implemented in pytorch

view repo

Please sign up or login with your details

Forgot password? Click here to reset