A Clinical Trial Derived Reference Set for Evaluating Observational Study Methods

06/24/2020
by   Ethan Steinberg, et al.
0

Informing clinical practice in a learning health system requires good causal inference methods in order to estimate the effects of drugs from observational studies. However, these methods rely on untestable assumptions, making it difficult to evaluate whether the returned drug effect estimates from a method are reliable, or to compare the effectiveness of different methods. In this work, we provide a reference set of the effects of drugs on various side effects based on public clinical trials data. We improve on prior reference sets by constructing a consistent statistical definition of positive and negative controls and by constructing our controls from clinical trials instead of drug package inserts or the literature. We also provide an example application, where we use the reference set to evaluate a suite of causal inference methods on observational medical claims data. In doing so, we find that the treatment effects estimated using inverse propensity weighting with propensity scores estimated via machine learning accurately separate the positive controls from the negative controls in our reference set.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/10/2022

Multi-Task Adversarial Learning for Treatment Effect Estimation in Basket Trials

Estimating treatment effects from observational data provides insights a...
research
07/16/2020

When deep learning meets causal inference: a computational framework for drug repurposing from real-world data

Drug repurposing is an effective strategy to identify new uses for exist...
research
05/15/2023

A Causal Inference Framework for Leveraging External Controls in Hybrid Trials

We consider the challenges associated with causal inference in settings ...
research
09/15/2022

Principles for Estimating Causal Effects in Observational Settings

To estimate causal effects, analysts performing observational studies in...
research
03/28/2018

A systematic approach to improving the reliability and scale of evidence from health care data

Concerns over reproducibility in science extend to research using existi...
research
09/16/2022

The use of external controls: To what extent can it currently be recommended?

With more and better clinical data being captured outside of clinical st...
research
12/06/2021

Using principal stratification in analysis of clinical trials

The ICH E9(R1) addendum (2019) proposed principal stratification (PS) as...

Please sign up or login with your details

Forgot password? Click here to reset