Reweighting the RCT for generalization: finite sample analysis and variable selection

08/16/2022
by   Bénédicte Colnet, et al.
0

The limited scope of Randomized Controlled Trials (RCT) is increasingly under scrutiny, in particular when samples are unrepresentative. Indeed, some RCTs over- or under- sample individuals with certain characteristics compared to the target population, for which one want to draw conclusions on treatment effectiveness. Re-weighting trial individuals to match the target population helps to improve the treatment effect estimation. Such procedures require an estimation of the ratio of the two densities (trial and target distributions). In this work, we establish the exact expressions of the bias and variance of such reweighting procedures – also called Inverse Propensity of Sampling Weighting (IPSW) – in presence of categorical covariates for any sample size. Such results allow us to compare the theoretical performance of different versions of IPSW estimates. Besides, our results show how the performance (bias, variance and quadratic risk) of IPSW estimates depends on the two sample sizes (RCT and target population). A by-product of our work is the proof of consistency of IPSW estimates. A refined analysis also shows that IPSW performances are improved when the trial probability to be treated is estimated (rather than using its oracle counterpart). In addition, we study how including covariates that are unnecessary to a proper estimation of the weights may impact the asymptotic variance. We illustrate all the takeaways twice: in a toy and didactic example, and on a semi-synthetic simulation inspired from critical care medicine.

READ FULL TEXT

page 39

page 40

research
05/13/2021

Generalizing a causal effect: sensitivity analysis and missing covariates

While a randomized controlled trial (RCT) readily measures the average t...
research
06/25/2018

An Outcome Model Approach to Translating a Randomized Controlled Trial Results to a Target Population

Participants enrolled into randomized controlled trials (RCTs) often do ...
research
04/23/2023

Policy Learning under Biased Sample Selection

Practitioners often use data from a randomized controlled trial to learn...
research
02/16/2019

Generalizing trial findings in nested trial designs with sub-sampling of non-randomized individuals

To generalize inferences from a randomized trial to the target populatio...
research
09/19/2022

Selection on treatment in the target population of generalizabillity and transportability analyses

Investigators are increasingly using novel methods for extending (genera...
research
02/15/2023

Causally-interpretable meta-analysis: clearly-defined causal effects and two case studies

Meta-analysis is commonly used to combine results from multiple clinical...
research
01/01/2023

Semidefinite programming on population clustering: a global analysis

In this paper, we consider the problem of partitioning a small data samp...

Please sign up or login with your details

Forgot password? Click here to reset