Odds Ratios are far from "portable": A call to use realistic models for effect variation in meta-analysis

06/04/2021
by   Mengli Xiao, et al.
0

Objective: Recently Doi et al. argued that risk ratios should be replaced with odds ratios in clinical research. We disagreed, and empirically documented the lack of portability of odds ratios, while Doi et al. defended their position. In this response we highlight important errors in their position. Study Design and Setting: We counter Doi et al.'s arguments by further examining the correlations of odds ratios, and risk ratios, with baseline risks in 20,198 meta-analyses from the Cochrane Database of Systematic Reviews. Results: Doi et al.'s claim that odds ratios are portable is invalid because 1) their reasoning is circular: they assume a model under which the odds ratio is constant and show that under such a model the odds ratio is portable; 2) the method they advocate to convert odds ratios to risk ratios is biased; 3) their empirical example is readily-refuted by counter-examples of meta-analyses in which the risk ratio is portable but the odds ratio isn't; and 4) they fail to consider the causal determinants of meta-analytic inclusion criteria: Doi et al. mistakenly claim that variation in odds ratios with different baseline risks in meta-analyses is due to collider bias. Empirical comparison between the correlations of odds ratios, and risk ratios, with baseline risks show that the portability of odds ratios and risk ratios varies across settings. Conclusion: The suggestion to replace risk ratios with odds ratios is based on circular reasoning and a confusion of mathematical and empirical results. It is especially misleading for meta-analyses and clinical guidance. Neither the odds ratio nor the risk ratio is universally portable. To address this lack of portability, we reinforce our suggestion to report variation in effect measures conditioning on modifying factors such as baseline risk; understanding such variation is essential to patient-centered practice.

READ FULL TEXT

page 1

page 2

page 3

page 4

06/25/2021

Statistical Methods for the meta-analysis paper by Itzhaky et al

This document describes the statistical methods used in Itzhaky et al ("...
07/13/2018

Incremental Sharpe and other performance ratios

We present a new methodology of computing incremental contribution for p...
05/15/2021

Disagreement Concerning Effect-Measure Modification

Stratifying factors, like age and gender, can modify the effect of treat...
10/16/2021

Minding non-collapsibility of odds ratios when recalibrating risk prediction models

In clinical prediction modeling, model updating refers to the practice o...
05/17/2019

Estimation of foreseeable and unforeseeable risks in motor insurance

This project works with the risk model developed by Li et al. (2015) and...