Contrastive Learning Improves Critical Event Prediction in COVID-19 Patients

01/11/2021
by   Tingyi Wanyan, et al.
10

Machine Learning (ML) models typically require large-scale, balanced training data to be robust, generalizable, and effective in the context of healthcare. This has been a major issue for developing ML models for the coronavirus-disease 2019 (COVID-19) pandemic where data is highly imbalanced, particularly within electronic health records (EHR) research. Conventional approaches in ML use cross-entropy loss (CEL) that often suffers from poor margin classification. For the first time, we show that contrastive loss (CL) improves the performance of CEL especially for imbalanced EHR data and the related COVID-19 analyses. This study has been approved by the Institutional Review Board at the Icahn School of Medicine at Mount Sinai. We use EHR data from five hospitals within the Mount Sinai Health System (MSHS) to predict mortality, intubation, and intensive care unit (ICU) transfer in hospitalized COVID-19 patients over 24 and 48 hour time windows. We train two sequential architectures (RNN and RETAIN) using two loss functions (CEL and CL). Models are tested on full sample data set which contain all available data and restricted data set to emulate higher class imbalance.CL models consistently outperform CEL models with the restricted data set on these tasks with differences ranging from 0.04 to 0.15 for AUPRC and 0.05 to 0.1 for AUROC. For the restricted sample, only the CL model maintains proper clustering and is able to identify important features, such as pulse oximetry. CL outperforms CEL in instances of severe class imbalance, on three EHR outcomes with respect to three performance metrics: predictive power, clustering, and feature importance. We believe that the developed CL framework can be expanded and used for EHR ML work in general.

READ FULL TEXT

page 5

page 6

page 13

page 14

page 18

page 19

page 23

page 24

research
04/07/2021

Bootstrapping Your Own Positive Sample: Contrastive Learning With Electronic Health Record Data

Electronic Health Record (EHR) data has been of tremendous utility in Ar...
research
05/19/2021

Reinforcement Learning Assisted Oxygen Therapy for COVID-19 Patients Under Intensive Care

Patients with severe Coronavirus disease 19 (COVID-19) typically require...
research
10/11/2021

SCEHR: Supervised Contrastive Learning for Clinical Risk Prediction using Electronic Health Records

Contrastive learning has demonstrated promising performance in image and...
research
08/03/2020

A Survey on the Use of AI and ML for Fighting the COVID-19 Pandemic

Artificial intelligence (AI) and machine learning (ML) have made a parad...
research
02/05/2021

Machine Learning in Precision Medicine to Preserve Privacy via Encryption

Precision medicine is an emerging approach for disease treatment and pre...
research
11/24/2020

Classification supporting COVID-19 diagnostics based on patient survey data

Distinguishing COVID-19 from other flu-like illnesses can be difficult d...
research
03/29/2022

HardVis: Visual Analytics to Handle Instance Hardness Using Undersampling and Oversampling Techniques

Despite the tremendous advances in machine learning (ML), training with ...

Please sign up or login with your details

Forgot password? Click here to reset