Statistical power for random assignment evaluations of education programs

Journal of Educational and Behavioral Statistics

Volumn 33, Issue 1, 2008, Pages 62-87

  Schochet, Peter Z ^a  

^a MATHEMATICA POLICY RESEARCH   (United States)

Author keywords

Evaluations of education programs; Experimental designs; Statistical power

Indexed keywords

EID: 40749144902     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/1076998607302714     Document Type: Article

References (35)

1. Bloom, H (2004). Randomizing groups to evaluate place-based programs. New York: MDRC.
2. Bloom, H, J Bos, and S Lee (1999). Using cluster random assignment to measure program impacts: Statistical implications for evaluation of education programs. Evaluation Review, 23 (4). 445-469.
3. Bryk, A, and S Raudenbush (1992). Hierarchical linear models for social and behavioral research. Applications and data analysis methods. Newbury Park, CA: Sage.
4. Cochran, W (1963). Sampling techniques. New York: John Wiley.
5. Cohen, J (1988). Statistical power analysis for behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum.
6. Cornfield, J (1978). Randomization by group: A formal analysis. American Journal of Epidemiology, 108 (2). 100-102.
7. Currie, J, and D Thomas (1999). Early test scores, socioeconomic status and future outcomes (NBER Working Paper No. 6943). Cambridge, MA: National Bureau of Economic Research.
8. Decker, P, and S Glazerman (2004). The effects of Teach For America on students: Findings from a national evaluation (Final report submitted to the U.S. Department of Education). Princeton, NJ: Mathematica Policy Research.
9. Donner, A, and N Klar (2000). Design and analysis of cluster randomization trials in health research. London: Arnold.
10. Dynarski, M, M Moore, L Rosenberg, S James-Burdumy, J Deke, and W Mansfield (2004). When schools stay open late: The national evaluation of the 21st Century Community Learning Centers Program, new findings. Princeton, NJ: Mathematica Policy Research.
11. Fleiss, JL (1986). The design and analysis of clinical experiments. New York: John Wiley.
12. Gargani, J, and T Cook (2005). How many schools? Limits of the conventional wisdom about sample size requirements for cluster randomized trials. Berkeley: University of California. Working paper.
13. Gleason, P, and R Olsen (2004). Impact evaluation of charter school strategies. Design documents. Princeton, NJ: Mathematica Policy Research.
14. Hedberg, E, R Santana, and L Hedges (2004). The variance structure of academic achievement in America. University of Chicago. Working paper.
15. Hedges, L (2004). Correcting significance tests for clustering. University of Chicago. Working paper.
16. Kane, T (2004). The impact of after-school programs: Interpreting the results of four recent evaluations. Los Angeles: University of California. Working paper.
17. Kane, T, and D Staiger (2002). The promise and pitfalls of using imprecise school accountability measures. Journal of Economic Perspectives, 16 (4). 91-114.
18. Kish, L (1965). Survey sampling. New York: John Wiley.
19. Krueger, A (2000). Economic considerations and class size (Working Paper No. 447). Princeton, NJ: Princeton University Industrial Relations Section.
20. Lipsey, MW, and DB Wilson (1993). The efficacy of psychological, educational, and behavioral treatment. American Psychologist, 48 (12). 1181-1209.
21. Murnane, R, J Willet, and F Levy (1995). The growing importance of cognitive skills in wage determination. Review of Economics and Statistics, 77, 251-266.
22. Murray, D (1998). Design and analysis of group-randomized trials. Oxford, UK: Oxford University Press.
23. Murray, D, S Varnell, and J Blitstein (2004). Design and analysis of group-randomized trials: A review of recent methodological developments. American Journal of Public Health, 94 (3). 423-432.
24. Myers, D, and A Schirm (1999). The impacts of upward bound: Final report for Phase I of the National Evaluation. Princeton, NJ: Mathematica Policy Research.
25. National Center for Education Statistics (2004). The nation's report card: Highlights 2003. Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Assessment of Educational Progress.
26. Neal, D, and W Johnson (1996). The role of premarket factors in Black-White wage differentials. Journal of Political Economy, 104, 869-895.
27. Raudenbush, S (1997). Statistical analysis and optimal design for cluster randomized trials. Psychological Methods, 2 (2). 173-185.
28. Raudenbush, S, J Spybrook, X Liu, and R Congdon (2004). Optimal design for longitudinal and multilevel research: Documentation for the Optimal Design software. Ann Arbor: University of Michigan.
29. Schochet, P (2005). Statistical power for random assignment evaluations of education programs. Princeton, NJ: Mathematica Policy Research.
30. Schochet, P, J Burghardt, and S Glazerman (2001). National Job Corps Study: The impacts of Job Corps on participants' employment and related outcomes. Princeton, NJ: Mathematica Policy Research.
31. Schochet, P, S James-Burdumy, and E Kisker (2004). Social and Character Development (SACD) Research Program: Analysis plan for the multisite impact analysis. Princeton, NJ: Mathematica Policy Research.
32. Searle, SR, G Casella, and CE McCulloch (1992). Variance components. New York: John Wiley.
33. Ukoumunne, O, M Gulliford, S Chinn, J Sterne, and P Burney (1999). Methods for evaluating area-wide and organisation-based interventions in health and health care: A systematic review. Health Technology Assessment, 3 (5). 1-98.
34. Varnell, S, D Murray, J Janega, and J Blitstein (2004). Design and analysis of group-randomized trials: A review of recent practices. American Journal of Public Health, 94 (3). 393-399.
35. Walsh, J (1947). Concerning the effects of the intra-class correlation on certain significance tests. Annals of Mathematical Statistics, 18, 88-96.