A Generalizable Artificial Intelligence Model for COVID-19 Classification Task Using Chest X-ray Radiographs: Evaluated Over Four Clinical Datasets with 15,097 Patients

10/04/2022
by   Ran Zhang, et al.
0

Purpose: To answer the long-standing question of whether a model trained from a single clinical site can be generalized to external sites. Materials and Methods: 17,537 chest x-ray radiographs (CXRs) from 3,264 COVID-19-positive patients and 4,802 COVID-19-negative patients were collected from a single site for AI model development. The generalizability of the trained model was retrospectively evaluated using four different real-world clinical datasets with a total of 26,633 CXRs from 15,097 patients (3,277 COVID-19-positive patients). The area under the receiver operating characteristic curve (AUC) was used to assess diagnostic performance. Results: The AI model trained using a single-source clinical dataset achieved an AUC of 0.82 (95 set. When applied to datasets from two external clinical sites, an AUC of 0.81 (95 0.79 (95 COVID-19 dataset collected by the Medical Imaging and Data Resource Center (MIDRC). A power-law dependence, N^(k )(k is empirically found to be -0.21 to -0.25), indicates a relatively weak performance dependence on the training data sizes. Conclusion: COVID-19 classification AI model trained using well-curated data from a single clinical site is generalizable to external clinical sites without a significant drop in performance.

READ FULL TEXT
research
02/18/2021

Deep learning-based COVID-19 pneumonia classification using chest CT images: model generalizability

Since the outbreak of the COVID-19 pandemic, worldwide research efforts ...
research
01/20/2023

DeepCOVID-Fuse: A Multi-modality Deep Learning Model Fusing Chest X-Radiographs and Clinical Variables to Predict COVID-19 Risk Levels

Propose: To present DeepCOVID-Fuse, a deep learning fusion model to pred...
research
11/10/2020

Pristine annotations-based multi-modal trained artificial intelligence solution to triage chest X-ray for COVID-19

The COVID-19 pandemic continues to spread and impact the well-being of t...
research
10/17/2022

Routine Usage of AI-based Chest X-ray Reading Support in a Multi-site Medical Supply Center

Research question: How can we establish an AI support for reading of che...
research
11/12/2021

Explaining medical AI performance disparities across sites with confounder Shapley value analysis

Medical AI algorithms can often experience degraded performance when eva...
research
09/12/2022

Development and Clinical Evaluation of an AI Support Tool for Improving Telemedicine Photo Quality

Telemedicine utilization was accelerated during the COVID-19 pandemic, a...

Please sign up or login with your details

Forgot password? Click here to reset