DeepAI
Log In Sign Up

Inverse Probability Weighting: the Missing Link between Survey Sampling and Evidence Estimation

04/29/2022
by   Jyotishka Datta, et al.
0

We consider the class of inverse probability weight (IPW) estimators, including the popular Horwitz-Thompson and Hajek estimators used routinely in survey sampling, causal inference and evidence estimation for Bayesian computation. We focus on the 'weak paradoxes' for these estimators due to two counterexamples by Basu (1988) and Wasserman (2004) and investigate the two natural Bayesian answers to this problem: one based on binning and smoothing : a 'Bayesian sieve' and the other based on a conjugate hierarchical model that allows borrowing information via exchangeability. We show that the two Bayesian estimators achieve lower mean squared errors in Wasserman's example compared to simple IPW estimators via simulation studies on a broad range of parameter configurations. We prove posterior consistency for the Bayes estimator and show how it requires fewer assumptions on the inclusion probabilities. We also revisit the connection between the different problems where improved or adaptive IPW estimators will be useful, including survey sampling, evidence estimation strategies such as Conditional Monte Carlo, Riemannian sum, Trapezoidal rules and vertical likelihood, as well as average treatment effect estimation in causal inference.

READ FULL TEXT

page 1

page 2

page 3

page 4

06/14/2021

Adaptive normalization for IPW estimation

Inverse probability weighting (IPW) is a general tool in survey sampling...
10/23/2019

Doubly robust treatment effect estimation with missing attributes

Missing attributes are ubiquitous in causal inference, as they are in mo...
05/22/2020

Navigated Weighting to Improve Inverse Probability Weighting for Missing Data Problems and Causal Inference

The inverse probability weighting (IPW) is broadly utilized to address m...
06/26/2021

Outlier-Resistant Estimators for Average Treatment Effect in Causal Inference

Estimators for causal quantities sometimes suffer from outliers. We inve...
08/04/2018

Improved Estimation of Average Treatment Effects on the Treated: Local Efficiency, Double Robustness, and Beyond

Estimation of average treatment effects on the treated (ATT) is an impor...
07/25/2017

Bayesian hierarchical weighting adjustment and survey inference

We combine Bayesian prediction and weighted inference as a unified appro...
10/24/2022

Overlap, matching, or entropy weights: what are we weighting for?

There has been a recent surge in statistical methods for handling the la...