Identifying and mitigating bias in algorithms used to manage patients in a pandemic

10/30/2021
by   Yifan Li, et al.
0

Numerous COVID-19 clinical decision support systems have been developed. However many of these systems do not have the merit for validity due to methodological shortcomings including algorithmic bias. Methods Logistic regression models were created to predict COVID-19 mortality, ventilator status and inpatient status using a real-world dataset consisting of four hospitals in New York City and analyzed for biases against race, gender and age. Simple thresholding adjustments were applied in the training process to establish more equitable models. Results Compared to the naively trained models, the calibrated models showed a 57 predictive performance, measured by area under the receiver/operating curve (AUC), remained unchanged. After calibration, the average sensitivity of the predictive models increased from 0.527 to 0.955. Conclusion We demonstrate that naively training and deploying machine learning models on real world data for predictive analytics of COVID-19 has a high risk of bias. Simple implemented adjustments or calibrations during model training can lead to substantial and sustained gains in fairness on subsequent deployment.

READ FULL TEXT
research
06/15/2019

PET/CT Radiomic Sequencer for Prediction of EGFR and KRAS Mutation Status in NSCLC Patients

The aim of this study was to develop radiomic models using PET/CT radiom...
research
06/30/2020

Do not forget interaction: Predicting fatality of COVID-19 patients using logistic regression

Amid the ongoing COVID-19 pandemic, whether COVID-19 patients with high ...
research
08/23/2019

Identification of Pediatric Sepsis Subphenotypes for Enhanced Machine Learning Predictive Performance: A Latent Profile Analysis

Background: While machine learning (ML) models are rapidly emerging as p...
research
10/09/2020

CryptoCredit: Securely Training Fair Models

When developing models for regulated decision making, sensitive features...
research
06/16/2023

A study on group fairness in healthcare outcomes for nursing home residents during the COVID-19 pandemic in the Basque Country

We explore the effect of nursing home status on healthcare outcomes such...
research
12/15/2022

Audio-based AI classifiers show no evidence of improved COVID-19 screening over simple symptoms checkers

Recent work has reported that AI classifiers trained on audio recordings...

Please sign up or login with your details

Forgot password? Click here to reset