Intraclass correlation values for planning group-randomized trials in education

Educational Evaluation and Policy Analysis

Volumn 29, Issue 1, 2007, Pages 60-87

  Hedges, Larry V ^a   Hedberg, E C ^b  

^a NORTHWESTERN UNIVERSITY   (United States)

^b UNIVERSITY OF CHICAGO   (United States)

Author keywords

Cluster randomized trials; Experiments; Intraclass correlation; Statistical power

Indexed keywords

EID: 34247269174     PISSN: 01623737     EISSN: None     Source Type: Journal    
DOI: 10.3102/0162373707299706     Document Type: Article

References (35)

1. Blair, R. C., & Higgins, J. J. (1986). Comment on "Statistical power with group mean as the unit of analysis." Journal of Educational Statistics, 11, 161-169.
2. Bloom, H. S. (1995). Minimum detectable effects: A simple way to report statistical power of experimental designs. Evaluation Review, 19, 547-556.
3. Bloom, H. S. (2005). Randomizing groups to evaluate place-based programs. In H. S. Bloom (Ed.), Learning more from social experiments: Evolving analytic approaches. New York: Russell Sage.
4. Bloom, H. S., Bos, J. M., & Lee, S. W. (1999). Using cluster random assignment to measure program impacts: Statistical implications for the evaluation of educational programs. Evaluation Review, 23, 445-469.
5. Bloom, H. S., Richburg-Hayes, L., & Black, A. R. (2007). Using covariates to improve precision for studies that randomize schools to evaluate educational interventions. Educational Evaluation and Policy Analysis, 29(1), 30-59.
6. Borenstein, M., Rothstein, H., & Cohen, J. (2001). Power and precision. Teaneck, NJ: Biostat.
7. Cohen, J. (1977). Statistical power analysis for the behavioral sciences (2nd ed.). New York: Academic Press.
8. Curtin, T. R., Ingels, S. J., Wu, S., & Heuer, R. (2002). User's manual: NELS:88 base-year to fourth followup. Washington, DC: National Center for Education Statistics.
9. Donner, A., Birkett, N., & Buck, C. (1981). Randomization by cluster. American Journal of Epidemiology, 114, 906-914.
10. Donner, A., & Klar, N. (2000). Design and analysis of cluster randomization trials in health research. London: Arnold.
11. Donner, A., & Koval, J. J. (1982). Design considerations in the estimation of intraclass correlation. Annals of Human Genetics, 46, 271-277.
12. Gulliford, M. C., Ukoumunne, O. C., & Chinn, S. (1999). Components of variance and intraclass correlations for the design of community-based surveys and intervention studies. Data from the Health Survey for England 1994. American Journal of Epidemiology, 149, 876-883.
13. Hedges, L. V. (in press-a). Correcting a significance test for clustering. Journal of Educational and Behavioral Statistics.
14. Hedges, L. V. (in press-b). Effect sizes in cluster randomized designs. Journal of Educational and Behavioral Statistics.
15. Hopkins, K. D. (1982). The unit of analysis: Group means versus individual observations. American Educational Research Journal, 19, 5-18.
16. Kish, L. (1965). Survey sampling. New York: Wiley.
17. Klar, N., & Donner, A. (2001). Current and future challenges in the design and analysis of cluster randomization trials. Statistics in Medicine, 20, 3729-3740.
18. Konstantopoulos, S. (2006). Statistical power in three-level designs (Working paper). Evanston, IL: Northwestern University, Institute for Policy Research.
19. Kraemer, H. C., & Thiemann, S. (1987). How many subjects? Statistical power analysis in research. Newbury Park, CA: Sage.
20. Lipsey, M. W. (1990). Design sensitivity: Statistical power analysis for experimental research. Newbury Park, CA: Sage.
21. Miller, J. D., Hoffer, T., Suchner, R. W., Brown, K. G., & Nelson, C. (1992). LSAY codebook. DeKalb: Northern Illinois University.
22. Miller, R. (1977). Simultaneous statistical inference. New York: Springer-Verlag.
23. Mosteller, F., & Boruch, R. (Eds.). (2002). Evidence matters: Randomized trials in education research. Washington, DC: Brookings Institution.
24. Murray, D. M. (1998). Design and analysis of group-randomized trials. New York: Oxford University Press.
25. Murray, D. M., & Blitstein, J. L. (2003). Methods to reduce the impact of intraclass correlation in group-randomized trials. Evaluation Review, 27, 79-103.
26. Murray, D. M., Hannan, P. J., & Baker, W. L. (1996). A Monte Carlo study of alternative responses to intraclass correlation in community trials. Evaluation Review, 20, 313-337.
27. Murray, D. M., Varnell, S. P., & Blitstein, J. L. (2004). Design and analysis of group-randomized trials: A review of recent methodological developments. American Journal of Public Health, 94, 423-432.
28. Puma, M. J., Karweit, N., Price, C., Riccuti, A., & Vaden-Kiernan, M. (1997). Prospects: Final report on student outcomes, Vol. II: Technical report. Cambridge, MA: Abt Associates.
29. Raudenbush, S. W. (1997). Statistical analysis and optimal design for cluster-randomized experiments. Psychological Methods, 2, 173-185.
30. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models. Thousand Oaks, C A: Sage.
31. Raudenbush, S. W., & Liu, X. (2000). Statistical power and optimal design for multisite randomized trials. Psychological Methods, 5, 199-213.
32. Schochet, P. Z. (2005). Statistical power for random assignment evaluations of educational programs. Princeton, NJ: Mathematica Policy Research.
33. Snijders, T., & Bosker, J. (1993). Standard errors and sample sizes for two-level research. Journal of Educational Statistics, 18, 237-259.
34. Tourangeau, K., Brick, M., Le, T., Nord, C., West, J., & Hausken, E. G. (2005). Early childhood longitudinal study, kindergarten class of 1998-99. Washington, DC: National Center for Education Statistics.
35. Verma, V., & Lee, T. (1996). An analysis of sampling errors for demographic and health surveys. International Statistical Review, 64, 265-294.