Social Science Statistics Blog

« App Stats: Nielsen on "Jihadi Radicalization of Muslim Clerics" | Main | App Stats: Kasy on "Identification in General Triangular Systems" »

24 September 2012

App Stats: Miratrix on "Random Weight Estimators: Adjusting Randomized Trials Without Using Observed Outcomes"

We hope you can join us this Wednesday, September 26, 2012 for the Applied Statistics Workshop. Luke Miratrix, Assistant Professor of Statistics in the Department of Statistics at Harvard University, will give a presentation entitled "Random Weight Estimators: Adjusting Randomized Trials Without Using Observed Outcomes". A light lunch will be served at 12 pm and the talk will begin at 12.15.

"Random Weight Estimators: Adjusting Randomized Trials Without Using Observed Outcomes"
Luke Miratrix
Department of Statistics, Harvard University
CGIS K354 (1737 Cambridge St.)
Wednesday, September 26th, 2012 12.00 pm

Abstract:

To increase the precision of a randomized trial, experimenters often adjust estimates of treatment effects using baseline covariates thought to predict the outcome of interest. In a previous paper, we proved that even under the Neyman-Rubin model, if the covariates and the method for adjustment are determined before randomization, this process can increase precision in a manner quite similar to a comparable blocked experiment. Typically, however, experimenters wish to adjust for the covariates that are most imbalanced between treatment and control, given the realized randomization. This leads to a much vexed variable selection problem that depends on the observed treatment assignment. To understand the issues behind this process, we examine a class of estimators we call "Random Weight Estimators" that adjust treatment effect estimates by weighting units with weights depending on a function on treatment assignment and covariates. While similar in spirit to blocking, these estimators can be applied "after the fact,'' i.e., after randomization has occurred, allowing them to naturally adapt to the observed treatment assignment. They can also adjust for many different covariates at once, including continuous ones. This class is quite general, and it includes traditional methods such as ordinary linear regression. Using our framework, we show, under the Neyman-Rubin model, how one can easily introduce potential bias using what would seem to be legitimate and simple approaches, especially in small and midsize experiments. Care must be taken with many forms of adjustment, even if an approach is selected without regard to any actual outcomes. We also extend this methodology to survey experiments, giving an appropriate and near-unbiased estimator for the treatment effect of a parent population. Throughout the talk, we illustrate this overall framework.

Posted by Konstantin Kashin at September 24, 2012 11:40 AM