Developing and validating multi-modal models for mortality prediction in COVID-19 patients: a multi-center retrospective study

09/01/2021
by   Joy Tzung-yu Wu, et al.
0

The unprecedented global crisis brought about by the COVID-19 pandemic has sparked numerous efforts to create predictive models for the detection and prognostication of SARS-CoV-2 infections with the goal of helping health systems allocate resources. Machine learning models, in particular, hold promise for their ability to leverage patient clinical information and medical images for prediction. However, most of the published COVID-19 prediction models thus far have little clinical utility due to methodological flaws and lack of appropriate validation. In this paper, we describe our methodology to develop and validate multi-modal models for COVID-19 mortality prediction using multi-center patient data. The models for COVID-19 mortality prediction were developed using retrospective data from Madrid, Spain (N=2547) and were externally validated in patient cohorts from a community hospital in New Jersey, USA (N=242) and an academic center in Seoul, Republic of Korea (N=336). The models we developed performed differently across various clinical settings, underscoring the need for a guided strategy when employing machine learning for clinical decision-making. We demonstrated that using features from both the structured electronic health records and chest X-ray imaging data resulted in better 30-day-mortality prediction performance across all three datasets (areas under the receiver operating characteristic curves: 0.85 (95 interval: 0.83-0.87), 0.76 (0.70-0.82), and 0.95 (0.92-0.98)). We discuss the rationale for the decisions made at every step in developing the models and have made our code available to the research community. We employed the best machine learning practices for clinical model development. Our goal is to create a toolkit that would assist investigators and organizations in building multi-modal models for prediction, classification and/or optimization.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 23

page 24

page 28

09/02/2021

Severity and Mortality Prediction Models to Triage Indian COVID-19 Patients

As the second wave in India mitigates, COVID-19 has now infected about 2...
01/23/2019

Interpretable Neural Networks for Predicting Mortality Risk using Multi-modal Electronic Health Records

We present an interpretable neural network for predicting an important c...
11/02/2021

Learning and Predicting from Dynamic Models for COVID-19 Patient Monitoring

COVID-19 has challenged health systems to learn how to learn. This paper...
04/21/2019

Radiogenomics models in precision radiotherapy: from mechanistic to machine learning

Machine learning provides a broad framework for addressing high-dimensio...
08/26/2021

Network Module Detection from Multi-Modal Node Features with a Greedy Decision Forest for Actionable Explainable AI

Network-based algorithms are used in most domains of research and indust...
10/30/2021

Identifying and mitigating bias in algorithms used to manage patients in a pandemic

Numerous COVID-19 clinical decision support systems have been developed....
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.