Generalizability of predictive models for intensive care unit patients

12/06/2018
by   Alistair E. W. Johnson, et al.
0

A large volume of research has considered the creation of predictive models for clinical data; however, much existing literature reports results using only a single source of data. In this work, we evaluate the performance of models trained on the publicly-available eICU Collaborative Research Database. We show that cross-validation using many distinct centers provides a reasonable estimate of model performance in new centers. We further show that a single model trained across centers transfers well to distinct hospitals, even compared to a model retrained using hospital-specific data. Our results motivate the use of multi-center datasets for model development and highlight the need for data sharing among hospitals to maximize model performance.

READ FULL TEXT

page 4

page 9

research
05/17/2020

predCOVID-19: A Systematic Study of Clinical Predictive Models for Coronavirus Disease 2019

Coronavirus Disease 2019 (COVID-19) is a rapidly emerging respiratory di...
research
08/27/2021

A comparison of approaches to improve worst-case predictive model performance over patient subpopulations

Predictive models for clinical outcomes that are accurate on average in ...
research
08/08/2023

When More is Less: Incorporating Additional Datasets Can Hurt Performance By Introducing Spurious Correlations

In machine learning, incorporating more data is often seen as a reliable...
research
02/26/2023

A Multidatabase ExTRaction PipEline (METRE) for Facile Cross Validation in Critical Care Research

Transforming raw EHR data into machine learning model-ready inputs requi...
research
03/27/2023

Generalisability of deep learning-based early warning in the intensive care unit: a retrospective empirical evaluation

Deep learning (DL) can aid doctors in detecting worsening patient states...
research
07/15/2022

Composite Scores for Transplant Center Evaluation: A New Individualized Empirical Null Method

Risk-adjusted quality measures are used to evaluate healthcare providers...

Please sign up or login with your details

Forgot password? Click here to reset