Falsification of Internal and External Validity in Observational Studies via Conditional Moment Restrictions

01/30/2023
by   Zeshan Hussain, et al.
0

Randomized Controlled Trials (RCT)s are relied upon to assess new treatments, but suffer from limited power to guide personalized treatment decisions. On the other hand, observational (i.e., non-experimental) studies have large and diverse populations, but are prone to various biases (e.g. residual confounding). To safely leverage the strengths of observational studies, we focus on the problem of falsification, whereby RCTs are used to validate causal effect estimates learned from observational data. In particular, we show that, given data from both an RCT and an observational study, assumptions on internal and external validity have an observable, testable implication in the form of a set of Conditional Moment Restrictions (CMRs). Further, we show that expressing these CMRs with respect to the causal effect, or "causal contrast", as opposed to individual counterfactual means, provides a more reliable falsification test. In addition to giving guarantees on the asymptotic properties of our test, we demonstrate superior power and type I error of our approach on semi-synthetic and real world datasets. Our approach is interpretable, allowing a practitioner to visualize which subgroups in the population lead to falsification of an observational study.

READ FULL TEXT
research
02/23/2021

A Review of Generalizability and Transportability

When assessing causal effects, determining the target population to whic...
research
12/27/2021

Combining randomized field experiments with observational satellite data to assess the benefits of crop rotations on yields

With climate change threatening agricultural productivity and global foo...
research
08/15/2020

A Calibration Approach to Transportability with Observational Data

An important consideration in clinical research studies is proper evalua...
research
10/10/2020

Combining Observational and Experimental Data Using First-stage Covariates

Randomized controlled trials generate experimental variation that can cr...
research
08/15/2022

Evaluating and improving real-world evidence with Targeted Learning

Purpose: The Targeted Learning roadmap provides a systematic guide for g...
research
09/27/2021

Conditional Cross-Design Synthesis Estimators for Generalizability in Medicaid

While much of the causal inference literature has focused on addressing ...
research
06/07/2019

Reliable Estimation of Individual Treatment Effect with Causal Information Bottleneck

Estimating individual level treatment effects (ITE) from observational d...

Please sign up or login with your details

Forgot password? Click here to reset