Minding non-collapsibility of odds ratios when recalibrating risk prediction models

by   Mohsen Sadatsafavi, et al.

In clinical prediction modeling, model updating refers to the practice of modifying a prediction model before it is used in a new setting. In the context of logistic regression for a binary outcome, one of the simplest updating methods is a fixed odds-ratio transformation of predicted risks to improve calibration-in-the-large. Previous authors have proposed equations for calculating this odds-ratio based on the discrepancy between the prevalence in the original and the new population, or between the average of predicted and observed risks. We show that this method fails to consider the non-collapsibility of odds-ratio. Consequently, it under-corrects predicted risks, especially when predicted risks are more dispersed (i.e., for models with good discrimination). We suggest an approximate equation for recovering the conditional odds-ratio from the mean and variance of predicted risks. Brief simulations and a case study show that this approach reduces under-correction, sometimes substantially. R code for implementation is provided.



page 1

page 2

page 3

page 4


Bayesian logistic regression for online recalibration and revision of risk prediction models with performance guarantees

After deploying a clinical prediction model, subsequently collected data...

Clinical Prediction Models to Predict the Risk of Multiple Binary Outcomes: a comparison of approaches

Clinical prediction models (CPMs) are used to predict clinically relevan...

Risk Projection for Time-to-event Outcome Leveraging Summary Statistics With Source Individual-level Data

Predicting risks of chronic diseases has become increasingly important i...

The harm of class imbalance corrections for risk prediction models: illustration and simulation using logistic regression

Methods to correct class imbalance, i.e. imbalance between the frequency...

Risk prediction models for discrete ordinal outcomes: calibration and the impact of the proportional odds assumption

Calibration is a vital aspect of the performance of risk prediction mode...

Odds Ratios are far from "portable": A call to use realistic models for effect variation in meta-analysis

Objective: Recently Doi et al. argued that risk ratios should be replace...

Model updating after interventions paradoxically introduces bias

Machine learning is increasingly being used to generate prediction model...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.