DeepAI AI Chat
Log In Sign Up

Sensitivity Analysis for Survey Weights

by   Erin Hartman, et al.

Survey weighting allows researchers to account for bias in survey samples, due to unit nonresponse or convenience sampling, using measured demographic covariates. Unfortunately, in practice, it is impossible to know whether the estimated survey weights are sufficient to alleviate concerns about bias due to unobserved confounders or incorrect functional forms used in weighting. In the following paper, we propose two sensitivity analyses for the exclusion of important covariates: (1) a sensitivity analysis for partially observed confounders (i.e., variables measured across the survey sample, but not the target population), and (2) a sensitivity analysis for fully unobserved confounders (i.e., variables not measured in either the survey or the target population). We provide graphical and numerical summaries of the potential bias that arises from such confounders, and introduce a benchmarking approach that allows researchers to quantitatively reason about the sensitivity of their results. We demonstrate our proposed sensitivity analyses using a 2016 U.S. Presidential Election poll.


page 1

page 2

page 3

page 4


Variance-based sensitivity analysis for weighting estimators result in more informative bounds

Weighting methods are popular tools for estimating causal effects; asses...

Synthetic Area Weighting for Measuring Public Opinion in Small Areas

The comparison of subnational areas is ubiquitous but survey samples of ...

Sensitivity Analysis in the Generalization of Experimental Results

Randomized controlled trials (RCT's) allow researchers to estimate causa...

On Interactions Between Observed and Unobserved Covariates in Matched Observational Studies

In observational studies, it is typically unrealistic to assume that tre...

Kpop: A kernel balancing approach for reducing specification assumptions in survey weighting

With the precipitous decline in response rates, researchers and pollster...

Bounding bias due to selection

When epidemiologic studies are conducted in a subset of the population, ...