Statistical power for regression discontinuity designs in education evaluations

Journal of Educational and Behavioral Statistics

Volumn 34, Issue 2, 2009, Pages 238-266

  Schochet, Peter Z ^a  

^a MATHEMATICA POLICY RESEARCH   (United States)

Author keywords

Evaluation; Experimental design; Statistics

Indexed keywords

EID: 68049122897     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/1076998609332748     Document Type: Article

References (41)

1. Angrist, J., Imbens, G., & Rubin, D. (1996). Identification of causal effects using instrumental variables. Journal of the American Statistical Association, 91, 444-472.
2. Bloom, H. (2004). Randomizing groups to evaluate place-based programs. New York, NY: MDRC.
3. Bloom, H., Bos, J., & Lee, S. (1999). Using cluster random assignment to measure program impacts: Statistical implications for evaluation of education programs. Evaluation Review, 23, 445-469.
4. Bloom, H., Hayes, L., & Black, A. (2005). Using covariates to improve precision. New York, NY: MDRC.
5. Byrk, A., & Raudenbush, S. (1992). Hierarchical linear models for social and behavioral research. Applications and data analysis Methods. Newbury Park, CA: Sage.
6. Campbell, D., & Stanley, J. (1963). Experimental and quasi-experimental designs for research on teaching. In N. L. Gage (Ed.). Handbook of research on teaching (pp. 171-246). Chicago: Rand McNally.
7. Cappelleri, J., Darlington, R., & Trochim, W. (1994). Power analysis of cutoff-based randomized clinical trials. Evaluation Review, 18, 141-152.
8. Cappelleri, J., & Trochim, W. (2003). Cutoff designs. In Encyclopedia of biopharmaceutical statistics (pp. 263-269). New York, NY: Marcel Dekker, Inc.
9. Cappelleri, J., Trochim, W., Stanley, T., & Reichardt, C. (1991). Random measurement error doesn't bias the treatment effect estimate in the regression-discontinuity design: The case of no interaction. Evaluation Review, 15, 395-419.
10. Cochran, W. (1963). Sampling techniques. New York: John Wiley and Sons.
11. Cohen, J. (1988). Statistical power analysis for behavioral sciences. Hillside, NJ: Lawrence Erlbaum.
12. Cook, T. (2008). Waiting for life to arrive: A history of the regression-discontinuity design in psychology, statistics, and economics. Journal of Econometrics, 142, 636-654.
13. Donner, A., Klar, N. (2000). Design and analysis of cluster randomization trials in health research. London: Arnold.
14. Fan, J., & Gijbels, I. (1996). Local polynomial modelling and its applications. London: Chapman and Hall.
15. Freedman, D. (2008). On regression adjustments to experimental data. Advances in Applied Mathematics, 40, 180-193.
16. Goldberger, A. (1972). Selection bias in evaluating treatment effects: Some formal illustrations. Working Paper, Economics Department, University of Wisconsin.
17. Griliches, Z., & Ringstad, V. (1971). Economies of scale and the form of the production function. Amsterdan: North Holland.
18. Hahn, J., Todd, P., & Van der Klaauw, W. (2001). Identification and estimation of treatment effects with a regression discontinuity design. Econometrica, 69, 201-209.
19. Heckman, J., & Vytlacil, E. (2005). Structural equations, treatment effects, and econometric policy evaluation. Econometrica, 73, 669-738.
20. Hedges, L., & Hedberg, E. (2007). Intraclass correlation values for planning group-randomized trials in education. Educational Evaluation and Policy Analysis, 29, 60-87.
21. Hill, C., Bloom, H., Black, A., & Lipsey, M. Empirical benchmarks for interpreting effect sizes in research. New York, NY: MDRC.
22. Holland, P. (1986). Statistics and causal inference. Journal of the American Statistical Association, 81, 945-960.
23. Imbens, G., & Lemieux, T. (2008). Waiting for life to arrive: Regression discontinuity designs: A guide to practice. Journal of Econometrics, 142, 615-635.
24. Imbens, G., & Rubin, D. (in press). Causal inference: Statistical methods for estimating causal effects in biomedical, social, and behavioral sciences. Cambridge, UK: Cambridge University Press.
25. Jacob, B., & Lefgren, L. (2004). Remedial education and student achievement: A regression-discontinuity analysis. Review of Economics and Statistics, 86, 226-244.
26. Kish, L. (1965). Survey sampling. New York: John Wiley & Sons.
27. Ludwig, J., & Miller, D. (2007). Does head start improve children's life chances? evidence from a regression discontinuity design. Quarterly Journal of Economics, 122, 159-208.
28. Maddala, G. (1983). Limited-dependent and qualitative variables in econometrics. Cambridge, UK: Cambridge University Press.
29. Murray, D. (1998). Design and analysis of group-randomized trials. Oxford, UK: Oxford University Press.
30. Neyman, J. (1990). On the application of probability theory to agricultural experiments: Essay on principles, section 9. Statistical Science, 5, 465-472. (Original work published 1923)
31. Porter, J. (2003). Estimation in the regression discontinuity model. Working Paper, Department of Economics, University of Wisconsin.
32. Rao, C. (1973). Linear statistical inference and its applications. New York: Wiley and Sons.
33. Raudenbush, S. (1997). Statistical analysis and optimal design for cluster randomized trials. Psychological Methods, 2, 173-185.
34. Rubin, D. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Education Psychology, 66, 688-701.
35. Rubin, D. (1997). Assignment to treatment group on the basis of a covariate. Journal of Education Statistics, 2, 1-26.
36. Schochet, P. (2007). Is regression adjustment supported by the Neyman model for causal inference? Working Paper, Mathematica Policy Research, Inc., Princeton, NJ.
37. Schochet, P. (2008a). Statistical power for random assignment evaluations of education programs. Journal of Educational and Behavioral Statistics, 33, 62-87.
38. Schochet, P. (2008b). Technical methods report: Statistical power for RD designs in evaluations of education programs. Princeton, NJ. Available from http://ies.ed.gov/ncee/
39. Shadish, W., Cook, T., & Campbell, D. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin Company.
40. Trochim, W. (1984). Research design for program evaluation: The regression-discontinuity design. Beverly Hills, CA: Sage Publications.
41. Yang, L., & Tsiatis, A. (2001). Efficiency study of estimators for a treatment effects in a pretest-posttest trial. American Statistician, 55, 314-321.