Evaluating and improving real-world evidence with Targeted Learning

08/15/2022
by   Susan Gruber, et al.
0

Purpose: The Targeted Learning roadmap provides a systematic guide for generating and evaluating real-world evidence (RWE). From a regulatory perspective, RWE arises from diverse sources such as randomized controlled trials that make use of real-world data, observational studies, and other study designs. This paper illustrates a principled approach to assessing the validity and interpretability of RWE. Methods: We applied the roadmap to a published observational study of the dose-response association between ritodrine hydrochloride and pulmonary edema among women pregnant with twins in Japan. The goal was to identify barriers to causal effect estimation beyond unmeasured confounding reported by the study's authors, and to explore potential options for overcoming the barriers that robustify results. Results: Following the roadmap raised issues that led us to formulate alternative causal questions that produced more reliable, interpretable RWE. The process revealed a lack of information in the available data to identify a causal dose-response curve. However, under explicit assumptions the effect of treatment with any amount of ritodrine versus none, albeit a less ambitious parameter, can be estimated from data. Conclusion: Before RWE can be used in support of clinical and regulatory decision-making, its quality and reliability must be systematically evaluated. The TL roadmap prescribes how to carry out a thorough, transparent, and realistic assessment of RWE. We recommend this approach be a routine part of any decision-making process.

READ FULL TEXT
research
05/17/2022

Targeted learning: Towards a future informed by real-world evidence

The 21st Century Cures Act of 2016 includes a provision for the U.S. Foo...
research
05/05/2016

Observational-Interventional Priors for Dose-Response Learning

Controlled interventions provide the most direct source of information f...
research
01/30/2023

Falsification of Internal and External Validity in Observational Studies via Conditional Moment Restrictions

Randomized Controlled Trials (RCT)s are relied upon to assess new treatm...
research
05/12/2023

A Causal Roadmap for Hybrid Randomized and Real-World Data Designs: Case Study of Semaglutide and Cardiovascular Outcomes

Introduction: Increasing interest in real-world evidence has fueled the ...
research
10/27/2022

Generating the right evidence at the right time: Principles of a new class of flexible augmented clinical trial designs

The past few years have seen an increasing number of initiatives aimed a...
research
01/17/2023

Causal Falsification of Digital Twins

Digital twins hold substantial promise in many applications, but rigorou...
research
03/28/2018

A systematic approach to improving the reliability and scale of evidence from health care data

Concerns over reproducibility in science extend to research using existi...

Please sign up or login with your details

Forgot password? Click here to reset