Covariance adjustments for the analysis of randomized field experiments

Evaluation Review

Volumn 37, Issue 3-4, 2013, Pages 170-196

  Berk, Richard ^a   Pitkin, Emil ^a   Brown, Lawrence ^a   Buja, Andreas ^a   George, Edward ^a   Zhao, Linda ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Covariate adjustments; Neyman causal model; Randomized field experiments

Indexed keywords

EPIDEMIOLOGY; HUMAN; PROCEDURES; RANDOMIZED CONTROLLED TRIAL (TOPIC); REGRESSION ANALYSIS; STATISTICAL ANALYSIS; STATISTICAL BIAS; STATISTICAL MODEL;

BIAS (EPIDEMIOLOGY); CAUSALITY; DATA INTERPRETATION, STATISTICAL; HUMANS; LINEAR MODELS; MODELS, STATISTICAL; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REGRESSION ANALYSIS;

EID: 84907722184     PISSN: 0193841X     EISSN: 15523926     Source Type: Journal    
DOI: 10.1177/0193841X13513025     Document Type: Article

References (30)

1. Asscher, J. L., M. Deković, W. A. Manders, P. H. van der Laan, and P. J. M. Prins. 2013. “A Randomized Controlled Trial of the Effectiveness of Multisystemic Therapy in the Netherlands: Post-treatment Changes and Moderator Effects.” Journal of Experimental Criminology 9:169-212.
2. Berk, R. A. 2005. “Randomized Experiments as the Bronze Standard.” Journal of Experimental Criminology 1:417-33.
3. Berk, R. A., G. Barnes, L. Ahlman, and E. Kurtz. 2010. “When Second Best is Good Enough: A Comparison between a True Experiment and a Regression Discontinuity Quasi-experiment.” Journal of Experimental Criminology 6: 191-208.
4. Cox, D. R. 1958. Planning of Experiments. New York: John Wiley.
5. Fisher, R. A. 1971. The Design of Experiments. 9th ed. London, England: Hafner Press.
6. Freedman, D. A. 2006. “Statistical Models of Causation: What Inferential Leverage Do They Provide?” Evaluation Review 30:691-713.
7. Freedman, D. A. 2008a. “On Regression Adjustments to Experimental Data.” Advances in Applied Mathematics 40:180-193.
8. Freedman, D. A. 2008b. “On Regression Adjustments in Experiments with Several Treatments.” Annals of Applied Statistics 2:176-96.
9. Freedman, D. A., R. Pisani, and R. Purves. 2007. Statistics. 4th ed. New York: Norton.
10. Graziano, L. M., D. P. Rosenbaum, and A. M. Schuck. 2013. “Building Group Capacity for Problem Solving and Police-community Partnerships through Survey Feedback and Training: A Randomized Control Trial with Chicago's Community Policing Program.” Journal of Experimental Criminology. Springer Online, January.
11. Heckman, J. J., and J. A. Smith. 1995. “Assessing the Case for Randomized Social Experiments.” Journal of Economic Perspectives 9:85-110.
12. Holland, P. W. 1986. “Statistics and Causal Inference.” Journal of the American Statistical Association 81:945-60.
13. Imbens, G. W., and J. M. Wooldridge. 2009. “Recent Development in the Econometrics of Program Evaluation.” Journal of Economic Literature 47:5-86.
14. James, L., B. Vila, and K. Daratha. 2013. “Results from Experimental Trials Testing Participant Resposes to White, Hispanic, and Black Suspects in High Fidelity Deadly Force Judgement and Decision-making Simulations.” Journal of Experimental Criminology 9:189-212.
15. Jeong, S., E. F. McGarrell, and N. K. Hipple. 2012. “Long-term Impact of Family Group Conferences on Re-offending: The Indianapolis Restorative Justice Experiment.” Journal of Experimental Criminology 8:369-85.
16. Jolin, A., R. Fountain, W. Feyerherm, and S. Friedman. 1996. Portland [Oregon] Domestic Violence Experiment, 1996 - 1997. ICPSR 3353, Ann Arbor, MI.
17. Kirk, R. W. 1982. Experimental Design. 2nd ed. Belmont, CA: Brooks/Cole.
18. Koper, C. S., B. G. Taylor, and D. J. Woods. 2013. “A Randomized Test of Initial and Residual Deterrence from Directed Patrols and Use of License Plate Readers at Crime Hot Spots.” Journal of Experimental Criminology 9:213-44.
19. Leeb, H., and B. M. Pötscher. 2006. “Can One Estimate the Conditional Distribution of Post-model-selection Estimators?” The Annals of Statistics 34: 2554-91.
20. Lin, W. 2013. “Agnostic Notes on Regression Adjustments to Experimental Data: Reexamining Freedman's Critique.” Annals of Applied Statistics 7:295-318.
21. Maxwell, C. D., R. C. Davis, and B. G. Taylor. 2010. “The Impact of Length of Domestic Violence Treatment on Patterns of Subsequent Intimate Partner Violence.” Journal of Experimental Criminology 6:419-45.
22. Miratrix, L. W., J. S. Sekhon, and B. Yu. 2013. “Adjusting Treatment Effect Estimates by Post-stratification in Randomized Experiments.” Journal of the Royal Statistical Society, Series B 75:369-96.
23. Neyman, J. 1923. “On The Application of Probability Theory to Agricultural Experiments.” In Statistical Science, translated and edited by D. M. Dabrowska and T. P. Speed (1990), 463-80 (with discussion).
24. Pitkin, E., L. Brown, and R. A. Berk. 2013. Improving Precision in Estimating Average Treatment Effects. Working Paper. Philadelphia: Department of Statistics, University of Pennsylvania.
25. Prendergast, M., L. Frisman, J. Y. Sacks, M. Staton-Tindall, L. Greenwell, H. J. Lin, and J. Catier. 2011. “A Multisite, Randomized Study of Strength-based Case Management with Substance-abusing Parolees.” Journal of Experimental Criminology 7:225-53.
26. Rice, J. A. 2007. Mathematical Statistics and Data Analysis. 3rd ed. Belmont, CA: Brooks/Cole.
27. Rosenbaum, P. R. 2009. Design of Observational Studies. New York: Springer.
28. Thompson, S. K. 2002. Sampling. 2nd ed. New York: John Wiley.
29. Wu, C. F. J, and M. Hamada. 2000. Experiments: Planning, Analysis, and Parameter Design Optimization. New York: John Wiley.
30. Wu, A. D., and B. D. Zumbo. 2008. “Understanding and Using Mediators and Moderators.” Social Indicators Research 87:367-92.