TranSOP: Transformer-based Multimodal Classification for Stroke Treatment Outcome Prediction

01/25/2023

∙

Acute ischaemic stroke, caused by an interruption in blood flow to brain tissue, is a leading cause of disability and mortality worldwide. The selection of patients for the most optimal ischaemic stroke treatment is a crucial step for a successful outcome, as the effect of treatment highly depends on the time to treatment. We propose a transformer-based multimodal network (TranSOP) for a classification approach that employs clinical metadata and imaging information, acquired on hospital admission, to predict the functional outcome of stroke treatment based on the modified Rankin Scale (mRS). This includes a fusion module to efficiently combine 3D non-contrast computed tomography (NCCT) features and clinical information. In comparative experiments using unimodal and multimodal data on the MRCLEAN dataset, we achieve a state-of-the-art AUC score of 0.85.

READ FULL TEXT

TranSOP: Transformer-based Multimodal Classification for Stroke Treatment Outcome Prediction

Prediction of Thrombectomy FunctionalOutcomes using Multimodal Data

autoTICI: Automatic Brain Tissue Reperfusion Scoring on 2D DSA Images of Acute Ischemic Stroke Patients

Prediction of Thrombectomy Functional Outcomes using Multimodal Data

CNN-LSTM Based Multimodal MRI and Clinical Data Fusion for Predicting Functional Outcome in Stroke Patients

MAMAF-Net: Motion-Aware and Multi-Attention Fusion Network for Stroke Diagnosis

Treatment Outcome Prediction for Intracerebral Hemorrhage via Generative Prognostic Model with Imaging and Tabular Data

Longitudinal Multimodal Transformer Integrating Imaging and Latent Clinical Signatures From Routine EHRs for Pulmonary Nodule Classification

TranSOP: Transformer-based Multimodal Classification for Stroke Treatment Outcome Prediction

Related Research

Prediction of Thrombectomy FunctionalOutcomes using Multimodal Data

autoTICI: Automatic Brain Tissue Reperfusion Scoring on 2D DSA Images of Acute Ischemic Stroke Patients

Prediction of Thrombectomy Functional Outcomes using Multimodal Data

CNN-LSTM Based Multimodal MRI and Clinical Data Fusion for Predicting Functional Outcome in Stroke Patients

MAMAF-Net: Motion-Aware and Multi-Attention Fusion Network for Stroke Diagnosis

Treatment Outcome Prediction for Intracerebral Hemorrhage via Generative Prognostic Model with Imaging and Tabular Data

Longitudinal Multimodal Transformer Integrating Imaging and Latent Clinical Signatures From Routine EHRs for Pulmonary Nodule Classification