An Empirical Investigation of Variance Design Parameters for Planning Cluster-Randomized Trials of Science Achievement

Evaluation Review

Volumn 37, Issue 6, 2013, Pages 490-519

  Westine, Carl D ^a   Spybrook, Jessaca ^a   Taylor, Joseph A ^b  

^a WESTERN MICHIGAN UNIVERSITY   (United States)

^b Biological Sciences Curriculum Study Colorado Springs   (United States)

Author keywords

cluster randomized trials; design parameters; hierarchical linear models; intraclass correlation; science education

Indexed keywords

EID: 84903177420     PISSN: 0193841X     EISSN: 15523926     Source Type: Journal    
DOI: 10.1177/0193841X14531584     Document Type: Article

References (32)

1. Bloom H. S.Learning More from Social Experiments Evolving Analytic Approaches. Bloom H. S., ed. New York: Russel Sage; 2005:115-72.
2. Bloom H. S.,Bos J. M.,Lee H."Using Cluster Random Assignment to Measure Program Impacts: Statistical Implications for the Evaluation of Education Programs.".Evaluation Review. 1999;23:445-69.
3. Bloom H. S.,Richburg-Hayes L.,Black A. R."Using Covariates to Improve Precision for Studies that Randomize Schools to Evaluate Educational Interventions.".Educational Evaluation and Policy Analysis. 2007;29:30-59.
4. Boruch R. F.,Foley E.Validity and Social Experiments: Donald Campbell's Legacy. Bickman L., ed. Thousand Oaks, CA: Sage; 2000:193-239.
5. Brandon P. R.,Harrison G. M.,Lawton B. E."SAS Code for Calculating Intraclass Correlation Coefficients and Effect Size Benchmarks for Site-randomized Education Experiments.".American Journal of Evaluation. 2013;34:85-90.
6. Cook T. D."Emergent Principles for the Design, Implementation, and Analysis of Cluster-based Experiments in Social Science.".The Annals of American Academy of Political and Social Science. 2005;599:176-98.
7. Donner A.,Klar N.Design and Analysis of Cluster Randomization Trials in Health Research. London, England: Arnold; 2000:.
8. Donner A.,Koval J. J."The Large Sample Variance of an Intraclass Correlation.".Biometrika. 1980;67:719-22.
9. Donner A.,Koval J. J."Design Considerations in the Estimation of Intraclass Correlation.".Annals of Human Genetics. 1982;46:271-77.
10. Fisher R. A.Statistical Methods for Research Workers. Edinborough, England: Oliver & Boyd; 1925:.
11. Gargani J.,Cook T.How Many Schools? Limits of the Conventional Wisdom about Sample Size Requirements for Cluster Randomized Trials. Berkeley: University of California; 2005:.
12. Hedberg E. C.2012:.
13. Hedberg E. C.,Hedges L. V.An Investigation of the Within- and Between-variance Structures of Academic Achievement in Massachusetts. Washington, DC: Society for Research on Educational Effectiveness; 2011:.
14. Hedges L. V.,Hedberg E. C."Intraclass Correlation Values for Planning Group-randomized Trials in Education.".Educational Evaluation and Policy Analysis. 2007;29:60-87.
15. Hedges L. V.,Hedberg E. C.,Kuyper A. M."The Variance of Intraclass Correlations in Three- and Four-level Models.".Educational and Psychological Measurement. 2012;72:893-909.
16. Randomized Control Trials Registry. 2013a:.
17. Search Funded Research Grants and Contracts. 2013b:.
18. Jacob R. T.,Goddard R. D.,Kim K. S."Assessing the Use of Aggregate Data in the Evaluation of School-based Interventions: Implications for Evaluation Research and State Policy Regarding Public-use Data.".Educational Evaluation and Policy Analysis. 2014;36:44-66.
19. Jacob R.,Zhu P.,Bloom H. S."New Empirical Evidence for the Design of Group Randomized Trials in Education.".Journal of Research on Educational Effectiveness. 2010;3:157-98.
20. Kelcey B.,Phelps G."Considerations for Designing Group Randomized Trials of Professional Development with Teacher Knowledge Outcomes.".Educational Evaluation and Policy Analysis. 2013;35:370-90.
21. Konstantopoulos S."Incorporating Cost in Power Analysis for Three-level Cluster-randomized Designs.".Evaluation Review. 2009;33:335-57.
22. Mosteller F.,Boruch R.Evidence Matters: Randomized Trials in Education Research. Washington, DC: Brookings Institution; 2002:.
23. Raudenbush S. W."Statistical Analysis and Optimal Design for Cluster Randomized Trials.".Psychological Methods. 1997;2:173-85.
24. Raudenbush S. W.,Bryk A. S.Heirarchical Linerar Models: Applications and Data Analysis Methods. 2002. Heirarchical Linerar Models: Applications and Data Analysis Methods. 2nd ed. Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 2002:.
25. Raudenbush S. W.,Liu X."Statistical Power and Optimal Design for Multisite Randomized Trials.".Psychological Methods. 2000;5:199-213.
26. Raudenbush S. W.,Martinez A.,Spybrook J."Strategies for Improving Precision in Group-randomized Experiments.".Educational Evaluation and Policy Analysis. 2007;29:5-29.
27. Schochet P. Z."Statistical Power for Random Assignment Evaluations of Education Programs.".Journal of Educational and Behavioral Statistics. 2008;33:62-87.
28. Spybrook J.,Bloom H.,Condon R.,Martinez A.,Raudenbush S. W.Optimal Design Plus Empirical Evidence: Documentation for the "Optimal Design" Software. Ann Arbor: University of Michigan; 2011:.
29. Spybrook J. K.,Raudenbush S. W."An Examination of the Precision and Technical Accuracy of the First Wave of Group-randomized Trials Funded by the Institute of Education Sciences.".Educational Evaluation and Policy Analysis. 2009;31:298-318.
30. Stata Statistical Software: Version 12. College Station, TX: StataCorp LP; 2011:.
31. Standardized Testing State by State. 2013:.
32. Zhu P.,Jacob R.,Bloom H.,Xu Z."Designing and Analyzing Studies that Randomize Schools to Estimate Intervention Effects on Student Academic Outcomes without Classroom-level Information.".Education Evaluation and Policy Analysis. 2012;34:45-68.