Standardized Mean Differences in Two-Level Cross-Classified Random Effects Models

Journal of Educational and Behavioral Statistics

Volumn 39, Issue 4, 2014, Pages 282-302

  Lai, Mark H C ^a   Kwok, Oi Man ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

Author keywords

cross classified random effects model; effect size; multilevel; randomized trials; standardized mean differece

Indexed keywords

EID: 84904320182     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/1076998614532950     Document Type: Article

References (36)

1. Ahn S.,Myers N. D.,Jin Y.Use of the estimated intraclass correlation for correcting differences in effect size by level.Behavior Research Methods. 2012;44:490-502.
2. Standards for reporting on empirical social science research in AERA publications.Educational Researcher. 2006;35:33-40.
3. Publication manual of the American Psychological Association. 2010). Publication manual of the American Psychological Association (6th ed.). Washington, DC: Author.Washington, DC: Author; 2010:.
4. Bauer D. J.,Sterba S. K.,Hallfors D. D.Evaluating group-based interventions when control participants are ungrouped.Multivariate Behavioral Research. 2008;43:210-236.
5. Beretvas S. N.Multilevel modeling of educational data. O'Connell A. A.McCoach D. B., ed. Charlotte, NC: Information Age; 2008:161-197.
6. Beretvas S. N.Handbook of advanced multilevel analysis. Hox J. J.Roberts J. K., ed. New York, NY: Routledge; 2010:313-334.
7. Cohen J.Statistical power analysis for the behavioral sciences. 1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.Hillsdale, NJ: Lawrence Erlbaum; 1988:.
8. Cohen J.The earth is round (p <.05).American Psychologist. 1994;49:997-1003.
9. Coyne M. D.,Simmons D.,Hagan-Burke S.,Simmons L. E.,Kwok O.,Kim M.,Rawlinson D. M.Adjusting beginning reading intervention based on student performance: An experimental evaluation.Exceptional Children. 2013;80:25-44.
10. Ferguson C.An effect size primer: A guide for clinicians and researchers.Professional Psychology: Research and Practice. 2009;40:532-538.
11. Friedel J. M.,Cortina K. S.,Turner J. C.,Midgley C.Changes in efficacy beliefs in mathematics across the transition to middle school: Examining the effects of perceived teacher and parent goal emphases.Journal of Educational Psychology. 2010;102:102-114.
12. Goldstein H.Multilevel mixed linear model analysis using iterative generalized least squares.Biometrika. 1986;73:43-56.
13. Goldstein H.Multilevel statistical models. Hoboken, NJ: Wiley; 2011:.
14. Grissom R. J.,Kim J. J.Effect sizes for research: Univariate and multivariate applications. 2012). Effect sizes for research: Univariate and multivariate applications (2nd ed.). New York, NY: Routledge.New York, NY: Routledge; 2012:.
15. Hedges L. V.Distribution theory for Glass's estimator of effect size and related estimators.Journal of Educational and Behavioral Statistics. 1981;6:107-128.
16. Hedges L. V.Effect sizes in cluster-randomized designs.Journal of Educational and Behavioral Statistics. 2007;32:341-370.
17. Hedges L. V.The handbook of research synthesis and meta-analysis. 2009). Effect sizes in nested designs. In CooperH.HedgesL. V.ValentineJ. C. (Eds.), The handbook of research synthesis and meta-analysis (2nd ed., pp. 337-355). New York, NY: Russell Sage Foundation.Cooper H.Hedges L. V.Valentine J. C., ed. New York, NY: Russell Sage Foundation; 2009:337-355.
18. Hedges L. V.Effect sizes in three-level cluster-randomized experiments.Journal of Educational and Behavioral Statistics. 2011;36:346-380.
19. Hedges L. V.,Hedberg E. C.Intraclass correlation values for planning group-randomized trials in education.Educational Evaluation and Policy Analysis. 2007;29:60-87.
20. Hox J. J.Multilevel analysis: Techniques and applications. 2010). Multilevel analysis: Techniques and applications (2nd ed.). New York, NY: Routledge.New York, NY: Routledge; 2010:.
21. Ingles S.,Abraham S. Y.,Rasinski K. A.,Karr R.,Spencer B.,Frankel M.National Educational Longitudinal Study of 1988: Base year student component data file user's manual. Washington, DC: U. S. Department of Education; 1990:.
22. Johnson I. Y.Contingent instructors and student outcomes: An artifact or a fact?.Research in Higher Education. 2011;52:761-785.
23. Lipsey M. W.,Wilson D. B.Practical meta-analysis. Thousand Oaks, CA: Sage; 2001:.
24. Littell R. C.,Milliken G. A.,Stroup W. W.,Wolfinger R. D.SAS system for mixed models. Cary, NC: SAS; 1996:.
25. Luo W.,Kwok O.The impacts of ignoring a crossed factor in analyzing cross-classified data.Multivariate Behavioral Research. 2009;44:182-212.
26. Luo W.,Kwok O.Proportional reduction of prediction error in cross-classified random effects models.Sociological Methods & Research. 2010;39:188-205.
27. Mason W. M.,Wong G. Y.,Entwisle B.Contextual analysis through multilevel linear model.Sociological Methodology. 1983;14:72-103.
28. Murray D. M.,Blitstein J. L.Methods to reduce the impact of intraclass correlation in group-randomized trials.Evaluation Review. 2003;27:79-103.
29. Muthén L. K.,Muthén B. O.Mplus user's guide. 1998-2012). Mplus user's guide (7th ed.). Los Angeles, CA: Author.Los Angeles, CA: Author; 1998-2012:.
30. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2013:.
31. Raudenbush S. W.,Bryk A. S.Hierarchical linear models: Applications and data analysis methods. 2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 2002:.
32. Searle S. R.,Casella G.,McCulloch C. E.Variance components. Hoboken, NJ: Wiley; 2006:.
33. Shi Y.,Leite W.,Algina J.The impact of omitting the interaction between crossed factors in cross-classified random effects modelling.British Journal of Mathematical and Statistical Psychology. 2010;63:1-15.
34. Snijders T. A. B.,Bosker R. J.Modeled variance in two-level models.Sociological Methods & Research. 1994;22:342-363.
35. Snijders T. A. B.,Bosker R. J.Multilevel analysis: An introduction to basic and advanced multilevel modeling. 2011). Multilevel analysis: An introduction to basic and advanced multilevel modeling (2nd ed.). London, England: Sage.London, England: Sage; 2011:.
36. Thompson B.Effect sizes, confidence intervals, and confidence intervals for effect sizes.Psychology in the Schools. 2007;44:423-432.