Multi-modal Graph Learning over UMLS Knowledge Graphs

07/10/2023
by   Manuel Burger, et al.
0

Clinicians are increasingly looking towards machine learning to gain insights about patient evolutions. We propose a novel approach named Multi-Modal UMLS Graph Learning (MMUGL) for learning meaningful representations of medical concepts using graph neural networks over knowledge graphs based on the unified medical language system. These representations are aggregated to represent entire patient visits and then fed into a sequence model to perform predictions at the granularity of multiple hospital visits of a patient. We improve performance by incorporating prior medical knowledge and considering multiple modalities. We compare our method to existing architectures proposed to learn representations at different granularities on the MIMIC-III dataset and show that our approach outperforms these methods. The results demonstrate the significance of multi-modal medical concept representations based on prior medical knowledge.

READ FULL TEXT

page 14

page 38

research
02/11/2022

Multi-Modal Knowledge Graph Construction and Application: A Survey

Recent years have witnessed the resurgence of knowledge engineering whic...
research
11/28/2022

Heterogeneous Graph Learning for Multi-modal Medical Data Analysis

Routine clinical visits of a patient produce not only image data, but al...
research
05/08/2019

Multi-modal Graph Fusion for Inductive Disease Classification in Incomplete Datasets

Clinical diagnostic decision making and population-based studies often r...
research
01/10/2022

Better Modeling the Programming World with Code Concept Graphs-augmented Multi-modal Learning

The progress made in code modeling has been tremendous in recent years t...
research
03/17/2023

Hospital Length of Stay Prediction Based on Multi-modal Data towards Trustworthy Human-AI Collaboration in Radiomics

To what extent can the patient's length of stay in a hospital be predict...
research
03/20/2022

Multi-Modal Learning Using Physicians Diagnostics for Optical Coherence Tomography Classification

In this paper, we propose a framework that incorporates experts diagnost...
research
06/07/2021

Multi-modal Entity Alignment in Hyperbolic Space

Many AI-related tasks involve the interactions of data in multiple modal...

Please sign up or login with your details

Forgot password? Click here to reset