The implications of "contamination" for experimental design in education

Journal of Educational and Behavioral Statistics

Volumn 36, Issue 1, 2011, Pages 76-104

  Rhoads, Christopher H ^a  

^a NORTHWESTERN UNIVERSITY   (United States)

Author keywords

cluster randomized experiments; contamination; experimental design; multilevel models; statistical power

Indexed keywords

EID: 79951881573     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/1076998610379133     Document Type: Article

References (30)

1. Baguley, T. (2009). Standardized or simple effect size: What should be reported? British Journal of Psychology, 100, 603-617.
2. Blitstein, J.L., Hannan, P.J., Murray, D.M., & Shadish, W.R. (2005). Increasing degrees of freedom in existing group randomized trials through the use of external estimates of intraclass correlation: The df* approach. Evaluation Review, 29, 241-267.
3. Bloom, H.S. (2005). Randomizing groups to evaluate place-based programs. In H. S. Bloom (Ed.), Learning more from social experiments: Evolving analytic approaches (pp. 115-172). New York, NY: Russell Sage Foundation.
4. Bloom, H.S., Richburg-Hayes, L., & Black, A.R. (2007). Using covariates to improve precision: Empirical guidelines for studies that randomize schools to measure the impacts of educational interventions. Educational Evaluation and Policy Analysis, 29, 30-59.
5. Borm, G.F., Melis, R.J.F., Teerenstra, S., & Peer, P.G. (2005). Pseudo cluster randomization: A treatment allocation method to minimize contamination and selection bias. Statistics in Medicine, 24, 3535-3547.
6. Campbell, M.K., Mollison, J., & Grimshaw, J.M. (2001). Cluster trials in implementation research: Estimation of intracluster correlation coefficients and sample size. Statistics in Medicine, 20, 391-399.
7. Cohen, J. (1977). Statistical power analysis for the behavioral sciences (2nd ed.). New York, NY: Academic Press.
8. Cornfield, J. (1978). Randomization by group: A formal analysis. American Journal of Epidemiology, 108, 100-102.
9. Donner, A., & Klar, N. (2000). Design and analysis of cluster randomization trials in health research. New York, NY: Oxford University Press.
10. Gargani, J., & Cook, T.D. (2005). How many schools? Limits of the conventional wisdom about sample size requirements for cluster randomized trials (Working paper). Evanston, IL: Northwestern University.
11. Hannan, P.J., Murray, D.M., Jacobs, D.R., & McGovern, P.G. (1994). Parameters to aid in the design and analysis of community trials: Intraclass correlations from the Minnesota Heart Health Program. Epidemiology, 5, 88-94.
12. Harris, A., & Lambert, L. (2003). Building leadership capacity for school improvement. New York, NY: McGraw Hill/Open University Press.
13. Hedges, L.V., & Hedberg, E.C. (2007). Intraclass correlation values for planning group-randomized trials in education. Educational Evaluation and Policy Analysis, 29, 60-87.
14. Institute of Education Sciences. (2009). Request for applications: Education research grants FY 2010. Washington, DC: U.S. Department of Education.
15. Kirk, R. (1995). Experimental design. Belmont, CA: Brooks Cole.
16. Konstantopoulos, S. (2008a). The power of the test for treatment effects in three-level cluster randomized designs. Journal of Research on Educational Effectiveness, 1, 66-88.
17. Konstantopoulos, S. (2008b). The power of the test for treatment effects in three-level block randomized designs. Journal of Research on Educational Effectiveness, 1, 265-288.
18. Maxwell, S., Kelley, K., & Rausch, J. (2008). Sample size planning for statistical power and accuracy in parameter estimation. Annual Review of Psychology, 59, 537-563.
19. National Science Foundation. (2009). Discovery research K-12 program solicitation NSF 09-602. Washington, DC: Government Printing Office.
20. Plewis, I., & Hurry, J. (1998). A multilevel perspective on the design and analysis of intervention studies. Educational Research and Evaluation, 4, 13-26.
21. Raudenbush, S.W. (1997). Statistical analysis and optimal design for cluster randomization trials. Psychological Methods, 2, 173-185.
22. Raudenbush, S.W., & Liu, X. (2000). Statistical analysis and optimal design for multisite randomized trials. Psychological Methods, 5, 199-213.
23. Raudenbush, S., Martinez, A., & Spybrook, J. (2007). Strategies for improving precision in group-randomized experiments. Educational Evaluation and Policy Analysis, 29, 5-29.
24. Scheier, W. M., & Dewey, W. L. (Eds.). (2007). The complete writing guide to NIH behavioral science grants. Oxford, NY: Oxford University Press.
25. Schmidt, F.L., & Hunter, J.E. (1997). Eight common but false objections to the discontinuation of significance testing in the analysis of research data. In L. A. Harlow, S. A. Mulaik, & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 37-64). Mahwah, NJ: Lawrence Erlbaum.
26. Schochet, P. (2008). Statistical power for random assignment evaluations of education programs. Journal of Educational and Behavioral Statistics, 33, 62-87.
27. Shadish, W.R., Cook, T.D., & Campbell, D.T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.
28. Slymen, D.J., & Hovell, M.F. (1997). Cluster versus individual randomization in adolescent tobacco and alcohol studies: Illustrations for design decisions. International Journal of Epidemiology, 26, 765-771.
29. Torgerson, D.J. (2001). Contamination in trials: Is cluster randomization the answer? British Medical Journal, 322, 355-357.
30. Ziliak, S.T., & McCloskey, D.N. (2004). Size matters: The standard error of regressions in the American Economic Review. The Journal of Socio-Economics, 33, 527-546.