Are power analyses reportedwith adequate detail? Evidence from the firstwave of group randomized trials funded by the institute of education sciences

Journal of Research on Educational Effectiveness

Volumn 1, Issue 3, 2008, Pages 215-235

  Spybrook, Jessaca ^a  

^a WESTERN MICHIGAN UNIVERSITY   (United States)

Author keywords

Experimental design; Group randomized trials; Statistical power

Indexed keywords

EID: 85009545323     PISSN: 19345747     EISSN: 19345739     Source Type: Journal    
DOI: 10.1080/19345740802114616     Document Type: Article

References (23)

1. Bloom, H. S. (1995). Minimum detectable effects: A simple way to report the statistical power of experimental designs. Evaluation Review, 19(5), 547-556.
2. Bloom, H. S. (2005). Randomizing groups to evaluate place-based programs. In H. S. Bloom (Ed.), Learning more from social experiments: Evolving analytic approaches (pp. 115-172). New York: Russell Sage Foundation.
3. Bloom, H. S., Bos, J. M., & Lee, S. W. (1999). Using cluster random assignment to measure program impacts: Statistical implications for the evaluation of education programs. Evaluation Review, 23(4), 445-469.
4. Bloom, H. S., Richburg-Hayes, L., & Black, A. R. (2007). Using covariates to improve precision: Empirical guidance for studies that randomize schools to measure the impacts of educational interventions. Educational Evaluation and Policy Analysis, 29(1), 30-59.
5. Boruch, R. F. (2005). Better evaluation for evidence based policy: Place randomized trials in education, criminology, welfare, and health. The Annals ofthe American Academy of Political and Social Science, 599, 6-18.
6. Boruch, R. F., & Foley, E. (2000). The honestly experimental society. In L. Bickman (Ed.). Validity and social experiments: Donald Campbell’s legacy (pp. 193-239). Thousand Oaks, CA: Sage.
7. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). New York: Academic
8. Cook, T. D. (2005). Emergent principles for the design, implementation, and analysis of cluster-based experiments in social science. The Annals of American Academy ofPolitical and Social Science, 599, 176-198.
9. Donner, A., & Klar, N. (2000). Design and analysis of cluster randomization trials in health research. London: Arnold.
10. Hedges, L., & Hedberg, E. C. (2007). Intraclass correlation values for planning grouprandomized trials in education. Educational Evaluation and Policy Analysis, 29(1), 60-87.
11. Institute of Education Sciences. (2008, February 29). Education research grants (CFDA No. 84.305A). Washington, DC: Author. Retrieved March 1, 2008, from http://ies.ed.gov/funding/pdf/2009_84305A.pdf
12. Konstantopoulos, S. (2008). The power of the test for treatment effects in three-level cluster randomized designs. Journal of Research on Educational Effectiveness, 1(1), 66-88.
13. Martinez, A., Raudenbush, S. W., & Spybrook, J. (2007, April). Fixed and randomeffects models for blocked group randomized trials. Poster presented at the annual meeting of the American Educational Research Association, Chicago.
14. Murray, D. M. (1998). Design and analysis ofgroup-randomized trials.NewYork: Oxford University Press.
15. Murray, D. M., & Blitstein, J. L. (2003). Methods to reduce the impact of intraclass correlation in group-randomized trials. Evaluation Review, 27(1), 79-103.
16. Raudenbush, S. W. (1997). Statistical analysis and optimal design for cluster randomized trials. Psychological Methods, 2(2) 173-185
17. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models (2nd ed.). Thousand Oaks, CA: Sage.
18. Raudenbush, S. W., Martinez, A., & Spybrook, J. (2007). Strategies for improving precision in group-randomized experiments. Educational Evaluation and Policy Analysis, 29(1), 5-29.
19. Schochet, P. (2008). Statistical power for random assignment evaluations of education programs. Journal of Educational and Behavioral Statistics, 33(1), 62-87.
20. Shadish, W. R., Cook, T. D., & Campbell, T. D. (2002). Experimental and quasiexperimental designs for generalized causal inference. Boston: Houghton Mifflin.
21. Snijders, T. A. B., & Bosker, R. J. (1999) Multilevel analysis. London: Sage.
22. Spybrook, J. (2007). Experimental designs and statistical power ofgroup randomized trials funded by the Institute of Education Sciences. Unpublished dissertation, University of Michigan, Ann Arbor.
23. Spybrook, J., Raudenbush, S. W., Liu, X., Congdon, R., & Martinez, A. (2008). Optimal design for longitudinal and multi-level research [Unpublished computer software]. University of Michigan.