Multilevel and Single-Level Models for Measured and Latent Variables When Data Are Clustered

Educational Psychologist

Volumn 51, Issue 3-4, 2016, Pages 317-330

  Stapleton, Laura M ^a   McNeish, Daniel M ^b   Yang, Ji Seung ^a  

^a UNIVERSITY OF MARYLAND   (United States)

^b UTRECHT UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84985031147     PISSN: 00461520     EISSN: None     Source Type: Journal    
DOI: 10.1080/00461520.2016.1207178     Document Type: Article

References (44)

1. A.Agresti, B.Caffo, & P.Ohman-Strickland, (2004). Examples in which misspecification of a random effects distribution reduces efficiency, and possible remedies. Computational Statistics & Data Analysis, 47, 639–653. http://dx.doi.org/10.1016/j.csda.2003.12.009
2. T.Asparouhov, & B.Muthén, (2006). Multilevel modeling of complex survey data. In Proceedings of the American Statistical Association (pp. 2718–2726). Seattle, WA:American Statistical Association.
3. D.J.Bauer, & S.K.Sterba, (2011). Fitting multilevel models with ordinal outcomes:Performance of alternative specifications and methods of estimation. Psychological Methods, 16, 373–390. http://dx.doi.org/10.1037/a0025813
4. D.A.Binder, & G.R.Roberts, (2003). Design-based and model-based methods for estimating model parameters. In R.L.Chambers & C.J.Skinner (Eds.), Analysis of survey data (pp. 29–48). Chichester, UK:Wiley & Sons.
5. R.F.Dedrick, J.M.Ferron, M.R.Hess, K.Y.Hogarty, J.D.Kromrey, T.R.Lang, … R.S.Lee, (2009). Multilevel modeling:A review of methodological issues and applications. Review of Educational Research, 79, 69–102. http://dx.doi.org/10.3102/0034654308325581
6. M.du Toit, & S.du Toit, (2008). Multilevel structural equation modeling. In J.de Leeuw & M.Meijer (Eds.), Handbook of multilevel analysis (pp. 435–478). New York, NY:Springer.
7. B.Efron, & R.J.Tibshirani, (1993). An introduction to the bootstrap. London, UK:Chapman & Hall.
8. C.K.Enders, & D.Tofigi, (2007). Centering predictor variables in cross-sectional multilevel models:A new look at an old issue. Psychological Methods, 12, 121–138. http://dx.doi.org/10.1037/1082-989X.12.2.121
9. J.Ferron, R.Dailey, & Q.Yi, (2002). Effects of misspecifying the first-level error structure in two-level models of change. Multivariate Behavioral Research, 37, 379–403. http://dx.doi.org/10.1207/S15327906MBR3703_4
10. R.A.Fisher, (1955). Statistical methods and scientific induction. Journal of the Royal Statistical Society. B, 17, 69–78.
11. B.Forer, & B.D.Zumbo, (2011). Validation of multilevel constructs:Validation methods and empirical findings for the EDI. Social Indicators Research, 103, 231–265. http://dx.doi.org/10.1007/s11205-011-9844-3
12. G.J.Geldhof, K.J.Preacher, & M.J.Zyphur, (2014). Reliability estimation in a multilevel confirmatory factor analysis framework. Psychological Methods, 19, 72–91. http://dx.doi.org/10.1037/a0032138
13. S.G.Heeringa, B.T.West, & P.A.Berglund, (2010). Applied survey data analysis. Boca Raton, FL:Chapman and Hall/CRC.
14. H.Jacqmin-Gadda, S.Sibillot, C.Proust, J.M.Molina, & R.Thiébaut, (2007). Robustness of the linear mixed model to misspecified error distribution. Computational Statistics & Data Analysis, 51, 5142–5154. http://dx.doi.org/10.1016/j.csda.2006.05.021
15. S.Jak, F.J.Oort, & C.V.Dolan, (2013). A test for cluster bias:Detecting violations of measurement invariance across clusters in multilevel data. Structural Equation Modeling, 20, 265–282. http://dx.doi.org/10.1080/10705511.2013.769392
16. G.Kalton, (1983). Models in the practice of survey sampling. International Statistical Review, 51, 175–188.
17. G.Kalton (2002). Models in the practice of survey sampling (revisited). Journal of Official Statistics, 18, 129–154.
18. A.Kamata, (2002). Item analysis by the hierarchical generalized linear model. Journal of Educational Measurement, 38, 79–93. Retrieved from http://www.jstor.org/stable/1435439
19. Kauermann, G., & Carroll, R. J. (2001). A note on the efficiency of sandwich covariance matrix estimation. Journal of the American Statistical Association, 96, 1387–1396. http://dx.doi.org/10.1198/940016214501753382309
20. Kenward, M. G., & Roger, J. H. (1997). Small sample inference for fixed effects from restricted maximum likelihood. Biometrics, 53, 983–997. doi:10.2307/2533558
21. S.W.J.Kozolowski, & K.J.Klein, (2000). A multi-level approach to theory and research in organizations:Contextual, temporal, and emergent processes. In K.J.Klein & S.W.J.Kozlowski (Eds.), Multi-level theory, research, and methods in organizations:Foundations extensions, and new directions (pp, 3–90). San Francisco, CA:Jossey-Bass.
22. K.Y.Liang, & S.L.Zeger, (1986). Longitudinal data analysis using generalized linear models. Biometrika, 73, 13–22.
23. B.Lu, J.S.Preisser, B.F.Qaqish, C.Suchindran, S.I.Bangdiwala, & M.Wolfson, (2007). A comparison of two bias-corrected covariance estimators for generalized estimating equations. Biometrics, 63, 935–941. http://dx.doi.org/10.1111/j.1541-0420.2007.00764.x
24. H.W.Marsh, O.Ludtke, B.Nagengast, U.Trautwein, A.J.S.Morin, A.S.Abduljabbar, & O.Koller, (2012). Classroom climate and contextual effects:Conceptual and methodological issues in the evaluation of group-level effects. Educational Psychologist, 47, 106–124. http://dx.doi.org/10.1080/00461520.2012.670488
25. D.B.McCoach, (2010). Hierarchical linear modeling. In G.R.Hancock & R.O.Mueller (Eds.), The reviewer's guide to quantitative methods in the social sciences (pp. 123–140). New York, NY:Routledge.
26. R.P.McDonald, (1970). The theoretical foundations of principal factor analysis, canonical factor analysis and alpha factor analysis. British Journal of Mathematical Psychology, 23, 1–21. http://dx.doi.org/10.1111/j.2044-8317.1970.tb00432.x
27. D.McNeish, & L.M.Stapleton, (2016). The effect of small sample size on two-level model estimates:A review and illustration. Educational Psychology Review, 28, 295–314. http://dx.doi.org/10.1007/s10648-014-9287-x
28. D.McNeish, L.M.Stapleton, & R.D.Silverman, (2016). On the unnecessary ubiquity of hierarchical linear modeling. Psychological Methods. Advance online publication. http://dx.doi.org/10.1037/met0000078
29. L.K.Muthén, & B.O.Muthén, (1998–2012). Mplus user's guide (7th ed.). Los Angeles, CA:Muthén & Muthén.
30. B.O.Muthén, & A.Satorra, (1995). Complex sample data in structural equation modeling. In P.V.Marsden (Ed.), Sociological methodology (pp. 267–316). Washington, DC:American Sociological Association.
31. J.Neyman, (1934). On the two different aspects of the representative method:The method of stratified sampling and the method of purposive selection. Journal of the Royal Statistical Society, 109, 558–606.
32. D.Pfeffermann, C.J.Skinner, D.J.Holmes, H.Goldstein, & J.Rasbash, (1998). Weighting for unequal selection probabilities in multi-level models. Journal of the Royal Statistical Society, Series B, 60, 23–40. http://www.jstor.org/stable/2985969
33. S.Rabe-Hesketh, & A.Skrondal, (2006). Multilevel modeling of complex survey data. Journal of the Royal Statistical Society, Series B, 60, 23–56. http://dx.doi.org/10.1111/j.1467-985X.2006.00426.x
34. S.W.Raudenbush, & A.S.Bryk, (2002). Hierarchical linear models:Applications and data analysis methods. Thousand Oaks, CA:Sage.
35. T.Raykov, & S.Penev, (2010). Evaluation of reliability coefficients for two-level models via latent variable analysis. Structural Equation Modeling:A Multidisciplinary Journal, 17, 629–641. http://dx.doi.org/10.1080/10705511.2010.510052
36. E.Ryu, & S.G.West, (2009). Level-specific evaluation of model fit in multilevel structural equation modeling. Structural Equation Modeling:A Multidisciplinary Journal, 16, 583–601. http://dx.doi.org/10.1080/10705510903203466
37. P.Z.Schochet, (2015). Statistical theory for the RCT-YES software:Design-based causal inference for RCTs (NCEE 2015–4011). Washington, DC:U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Analytic Technical Assistance and Development. Retrieved from http://ies.ed.gov/ncee/edlabs.
38. L.M.Stapleton, (2006). An assessment of practical solutions for structural equation modeling with complex sample data. Structural Equation Modeling:A Multidisciplinary Journal, 13, 28–58. http://dx.doi.org/10.1207/s15328007sem1301_2
39. L.M.Stapleton, (2008). Variance estimation using replication methods in structural equation modeling with complex sample data. Structural Equation Modeling:A Multidisciplinary Journal, 15, 183–210. http://dx.doi.org/10.1080/10705510801922316
40. L.M.Stapleton, (2013). Using multilevel structural equation modeling techniques with complex sample data. In G.R.Hancock & R.O.Mueller (Eds.), Structural equation modeling:A second course (2nd ed., pp. 521–562). Charlotte, NC:Information Age.
41. L.M.Stapleton, J.S.Yang, & G.R.Hancock, (2016). Construct meaning in multilevel settings. Journal of Educational and Behavioral Statistics. Advance online publication. http://dx.doi.org/10.3102/1076998616646200
42. S.K.Sterba, (2009). Alternative model-based and design-based frameworks for inference from samples to populations:From polarization to integration. Multivariate Behavioral Research, 44, 711–740. http://dx.doi.org/10.1080/00273170903333574
43. K.Tourangeau, C.Nord, T.Le, A.G.Sorongon, M.Najarian, & E.G.Hausken, (2009). Early Childhood Longitudinal Study, Kindergarten Class of 1998–99 (ECLS-K):Combined User's Manual for the ECLS-K Eight-Grade and K-8 Full Sample Data Files and Electronic Codebooks. Washington, DC:National Center for Education Statistics.
44. W.M.Yen, (1993). Scaling performance assessments:Strategies for managing local item dependence. Journal of Educational Measurement, 30, 187–213.