Bias and high-dimensional adjustment in observational studies of peer effects

06/14/2017
by   Dean Eckles, et al.
0

Peer effects, in which the behavior of an individual is affected by the behavior of their peers, are posited by multiple theories in the social sciences. Other processes can also produce behaviors that are correlated in networks and groups, thereby generating debate about the credibility of observational (i.e. nonexperimental) studies of peer effects. Randomized field experiments that identify peer effects, however, are often expensive or infeasible. Thus, many studies of peer effects use observational data, and prior evaluations of causal inference methods for adjusting observational data to estimate peer effects have lacked an experimental "gold standard" for comparison. Here we show, in the context of information and media diffusion on Facebook, that high-dimensional adjustment of a nonexperimental control group (677 million observations) using propensity score models produces estimates of peer effects statistically indistinguishable from those from using a large randomized experiment (220 million observations). Naive observational estimators overstate peer effects by 320 demographics) offer little bias reduction, but adjusting for a measure of prior behaviors closely related to the focal behavior reduces bias by 91 High-dimensional models adjusting for over 3,700 past behaviors provide additional bias reduction, such that the full model reduces bias by over 97 This experimental evaluation demonstrates that detailed records of individuals' past behavior can improve studies of social influence, information diffusion, and imitation; these results are encouraging for the credibility of some studies but also cautionary for studies of rare or new behaviors. More generally, these results show how large, high-dimensional data sets and statistical learning techniques can be used to improve causal inference in the behavioral sciences.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/04/2021

Identification and Estimation of Causal Peer Effects Using Double Negative Controls for Unmeasured Network Confounding

Scientists have been interested in estimating causal peer effects to und...
research
05/18/2020

Learning Adjustment Sets from Observational and Limited Experimental Data

Estimating causal effects from observational data is not always possible...
research
02/16/2020

Regression-based Negative Control of Homophily in Dyadic Peer Effect Analysis

A prominent threat to causal inference about peer effects over social ne...
research
06/22/2020

A Causally Formulated Hazard Ratio Estimation through Backdoor Adjustment on Structural Causal Model

Identifying causal relationships for a treatment intervention is a funda...
research
02/19/2019

Estimating Network Effects Using Naturally Occurring Peer Notification Queue Counterfactuals

Randomized experiments, or A/B tests are used to estimate the causal imp...
research
07/27/2023

RCT Rejection Sampling for Causal Estimation Evaluation

Confounding is a significant obstacle to unbiased estimation of causal e...
research
01/27/2022

Heterogeneous Peer Effects in the Linear Threshold Model

The Linear Threshold Model is a widely used model that describes how inf...

Please sign up or login with your details

Forgot password? Click here to reset