This is not the latest version of this item. The latest version can be found here.
Bias and High-Dimensional Adjustment in Observational Studies of Peer Effects
Name
1706.04692.pdf
Description
Submitted version
Size
613.16 KB
Format
Adobe PDF
Checksum (MD5)
c4206979f6a98390a8b101cb1a5ae54b
Author(s)
Eckles, Dean
Bakshy, Eytan
Date Issued
2021
Journal
Journal of the American Statistical Association
Publisher
Informa UK Limited
Version
Original manuscript
Abstract
© 2020 American Statistical Association. Peer effects, in which an individual’s behavior is affected by peers’ behavior, are posited by multiple theories in the social sciences. Randomized field experiments that identify peer effects, however, are often expensive or infeasible, so many studies of peer effects use observational data, which is expected to suffer from confounding. Here we show, in the context of information and media diffusion, that high-dimensional adjustment of a nonexperimental control group (660 million observations) using propensity score models produces estimates of peer effects statistically indistinguishable from those using a large randomized experiment (215 million observations). Compared with the experiment, naive observational estimators overstate peer effects by over 300% and commonly available variables (e.g., demographics) offer little bias reduction. Adjusting for a measure of prior behaviors closely related to the focal behavior reduces this bias by 91%, while models adjusting for over 3700 past behaviors provide additional bias reduction, reducing bias by over 97%, which is statistically indistinguishable from unbiasedness. This demonstrates how detailed records of behavior can improve studies of social influence, information diffusion, and imitation; these results are encouraging for the credibility of some studies but also cautionary for studies of peer effects in rare or new behaviors. More generally, these results show how large, high-dimensional datasets and statistical learning can be used to improve causal inference. Supplementary materials for this article are available online.
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
Persistent DSpace Link
DOI of Published Version
10.1080/01621459.2020.1796393
