Use of the estimated intraclass correlation for correcting differences in effect size by level

Behavior Research Methods

Volumn 44, Issue 2, 2012, Pages 490-502

  Ahn, Soyeon ^a   Myers, Nicolas D ^a   Jin, Ying ^a  

^a UNIVERSITY OF MIAMI   (United States)

Author keywords

Intraclass correlation (ICC); Level of analysis; Meta analysis; Multilevel; Standardized mean difference

Indexed keywords

ALGORITHM; ARTICLE; CLUSTER ANALYSIS; EPIDEMIOLOGY; META ANALYSIS (TOPIC); METHODOLOGY; POPULATION; SAMPLE SIZE; STATISTICAL ANALYSIS;

ALGORITHMS; BIAS (EPIDEMIOLOGY); CLUSTER ANALYSIS; DATA INTERPRETATION, STATISTICAL; META-ANALYSIS AS TOPIC; POPULATION; RESEARCH DESIGN; SAMPLE SIZE;

EID: 84861352446     PISSN: 1554351X     EISSN: 15543528     Source Type: Journal    
DOI: 10.3758/s13428-011-0153-1     Document Type: Article

References (24)

1. Ahn, S., & Becker, B. J. (2011). Incorporating quality scores in meta-analyses. Manuscript submitted for publication.
2. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum.
3. Cooper, H., Hedges, L., & Valentine, J. (2009). The handbook of research synthesis and meta-analysis (2nd ed.). New York: Russell Sage Foundation.
4. Hedges, L. V. (2007). Correcting a significance test for clustering. Journal of Educational and Behavioral Statistics, 32, 151-179.
5. Hedges, L. V. (2009a). Adjusting a significance test for clustering in designs with two levels of nesting. Journal of Educational and Behavioral Statistics, 34, 464-490.
6. Hedges, L. V. (2009b). Effect sizes in nested designs. In H. M. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (pp. 337-355). New York: Russell Sage Foundation.
7. Hedges, L. V., & Hedberg, E. C. (2007). Intraclass correlation for planning group randomized experiments in education. Educational Evaluation and Policy analysis, 29, 60-87.
8. Hoogland, J. J., & Boomsma, A. (1998). Robustness studies in covariance structure modeling: An overview and a meta-analysis. Sociological Methods and Research, 26, 329-367.
9. Hox, J. J. (2002). Multilevel analysis: Techniques and applications. Mahwah, NJ: Erlbaum.
10. Hox, J. J., & Maas, C. J. M. (2001). The accuracy of multilevel structural equation modeling with pseudobalanced groups and small samples. Structural Equation Modeling, 8, 157-174.
11. Hox, J. J., Maas, C. J. M., & Brinkhuis, M. J. S. (2010). The effect of estimation method and sample size in multilevel structural equation modeling. Statistica Neerlandica, 64, 157-170.
12. Kreft, I., & de Leeuw, J. (1998). Introducing multilevel modeling. Thousand Oaks, CA: Sage.
13. Maerten-Rivera, J., Myers, N. D., Lee, O., & Penfield, R. (2010). Student and school predictors of high-stakes assessment in science. Science Education, 94, 937-962.
14. Mol, S. E., Bus, A. G., & de Jong, M. T. (2009). Interactive book reading in early education: A tool to stimulate print knowledge as well as oral language. Review of Educational Research, 79, 979-1007.
15. Myers, N. D., Feltz, D. L., Maier, K. S., Wolfe, E. W., & Reckase, M. D. (2006). Athletes' evaluations of their head coach's coaching competency. Research Quarterly for Exercise and Sport, 77, 111-121.
16. R Development Core Team. (2008). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.
17. Raudenbush, S. W. (1994). Random-effects model. In H. M. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 301-323). New York: Russell Sage Foundation.
18. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Newbury Park, CA: Sage.
19. Robinson, W. S. (1950). Ecological correlation and the behavior of individuals. American Sociological Review, 15, 351-357.
20. Salinas, A. (2010). Investing in teachers: What focus of professional development lead to the highest student gains in mathematics achievement?. Unpublished doctoral dissertation, University of Miami.
21. Scher, L., & O'Reilly, F. (2009). Professional development for K-12 math and science teacher: What do we really know? Journal of Research on Educational Effectiveness, 2, 209-249.
22. Slavin, R. E., Lake, C., Chambers, B., Chueng, A., & Davis, S. (2009). Effective reading programs for the elementary grades: A best-evidence synthesis. Review of Educational Research, 79, 1391-1466.
23. Swanson, H. L., & Hsieh, C.-J. (2009). Reading disabilities in adults: A selective meta-analysis of literature. Review of Educational Research, 79, 1362-1390.
24. What Works Clearinghouse. (2008). Procedures and standards handbook (version 2. 0). Retrieved June 4, 2010, from http://ies. ed. gov/ncee/wwc/pdf/wwc_procedures_v2_standards_handbook. pdf.