A Test for Cluster Bias: Detecting Violations of Measurement Invariance Across Clusters in Multilevel Data

Structural Equation Modeling

Volumn 20, Issue 2, 2013, Pages 265-282

  Jak, Suzanne ^a   Oort, Frans J ^a   Dolan, Conor V ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

cluster bias; measurement bias; multilevel structural equation modeling

Indexed keywords

CLUSTER BIAS; FACTOR MODEL; FALSE POSITIVE; MEASUREMENT BIAS; MULTILEVEL DATA; MULTILEVEL STRUCTURAL EQUATION; RESIDUAL VARIANCE; SIMULATION STUDIES;

EID: 84876276953     PISSN: 10705511     EISSN: 15328007     Source Type: Journal    
DOI: 10.1080/10705511.2013.769392     Document Type: Article

References (39)

1. Barendse, M. T., Oort, F. J. and Garst, G. J. A. 2010. Using restricted factor analysis with latent moderated structures to detect uniform and nonuniform measurement bias: A simulation study. Advances in Statistical Analysis, 94: 117-127.
2. Barendse, M. T., Oort, F. J., Werner, C. S., Ligtvoet, R. and Schermelleh-Engel, K. 2012. Measurement bias detection through factor analysis. Structural Equation Modeling, 19: 561-579.
3. Browne, M. W. and Cudeck, R. 1992. Alternative ways of assessing model fit. Sociological Methods & Research, 21: 230-258.
4. Byrne, B. M., Shavelson, R. J. and Muthén, B. 1989. Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105: 456-466.
5. Byrne, B. M. and van de Vijver, F. J. R. 2010. Testing for measurement and structural equivalence in large-scale cross-cultural studies: Addressing the issue of nonequivalence. International Journal of Testing, 10: 107-132.
6. Grilli, L. and Rampichini, C. 2007. Multilevel factor models for ordinal variables. Structural Equation Modeling, 14: 1-25.
7. Hox, J. 2002. Multilevel analysis: Techniques and applications. Mahwah, NJ: Erlbaum.
8. Hox, J., Maas, C. J. M. and Brinkhuis, M. J. S. 2010. The effect of estimation method and sample size in multilevel structural equation modeling. Statistica Neerlandica, 64: 157-170.
9. Lubke, G. H., Dolan, C. V., Kelderman, H. and Mellenbergh, G. J. 2003. Weak measurement invariance with respect to unmeasured variables: An implication of strict factorial invariance. British Journal of Mathematical and Statistical Psychology, 56: 231-248.
10. Marsh, H. W. and Hocevar, D. 1984. The factorial invariance of students' evaluations of college teaching. American Educational Research Journal, 21: 341-366.
11. Mellenbergh, G. J. 1989. Item bias and item response theory. International Journal of Educational Statistics, 13: 127-143.
12. Mellenbergh, G. J. 1994. A unidimensional latent trait model for continuous item responses. Multivariate Behavioral Research, 29: 223-236.
13. Meredith, W. 1993. Measurement invariance, factor analysis, and factorial invariance. Psychometrika, 58: 525-543.
14. Meredith, W. and Teresi, J. A. 2006. An essay on measurement and factorial invariance. Medical Care, 44: 69-77.
15. Millsap, R. E. and Everson, H. 1991. Confirmatory measurement model comparison using latent means. Multivariate Behavioral Research, 26: 479-497.
16. Millsap, R. E. and Yun-Tein, J. 2004. Assessing factorial invariance in ordered-categorical measures. Multivariate Behavioral Research, 39: 479-515.
17. Muthén, B. 1989. Latent variable modeling in heterogeneous populations. Psychometrika, 54: 557-585.
18. Muthén, B. 1990. Mean and covariance structure analysis of hierarchical data. Los Angeles, CA: UCLA.
19. Muthén, B., Kaplan, D. and Hollis, M. 1987. On structural equation modeling with data that are not missing completely at random. Psychometrika, 52: 431-462.
20. Muthén, L. K. and Muthén, B. O. 2007. Mplus users guide, 5th ed. Los Angeles, CA: Muthén & Muthén.
21. Oort, F. J. 1992. Using restricted factor analysis to detect item bias. Methodika, 6: 150-166.
22. Oort, F. J. 1998. Simulation study of item bias detection with restricted factor analysis. Structural Equation Modeling, 5: 107-124.
23. Preacher, K. J., Zyphur, M. J. and Zhang, Z. 2010. A general multilevel SEM framework for multilevel mediation. Psychological Methods, 15: 209-233.
24. R Development Core Team. 2010. R: A language and environment for statistical computing [Computer software] Vienna, Austria: Author.
25. Rabe-Hesketh, S., Skrondal, A. and Pickles, A. 2004. Generalized multilevel structural equation modelling. Psychometrika, 69: 167-190.
26. Rasbash, J. and Goldstein, H. 1994. Efficient analysis of mixed hierarchical and cross-classified random structures using a multilevel model. Journal of Educational and Behavioral Statistics, 19: 337-350.
27. Reise, S. P., Widaman, K. F. and Pugh, R. H. 1993. Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin, 114: 552-566.
28. Ryu, E. and West, S. G. 2009. Level-specific evaluation of model fit in multilevel structural equation modelling. Structural Equation Modeling, 16: 583-601.
29. Satorra, A. and Bentler, P. M. 2010. Ensuring positiveness of the scaled difference chi-square test statistic. Psychometrika, 75: 243-248.
30. Selig, J. P., Card, N. A. and Little, T. D. 2008. "Latent variable structural equation modeling in cross-cultural research: Multigroup and multilevel approaches.". In Multilevel analysis of individuals and cultures Edited by: Van de Vijver, F. J. R., van Hemert, D. A. and Poortinga, Y. 93-119. Mahwah, NJ: Erlbaum.
31. Smits, I. A., Dolan, C. V., Vorst, H. C., Wicherts, J. M. and Timmerman, M. E. 2011. Cohort differences in Big Five personality factors over a period of 25 years. Journal of Personality and Social Psychology, 100: 1124-1138.
32. Snijders, T. A. B. and Bosker, R. J. 1999. Multilevel analysis: An introduction to basic and advanced multilevel modeling. Thousand Oaks, CA: Sage.
33. Sörbom, D. 1974. A general method for studying differences in factor means and factor structures between groups. British Journal of Mathematical and Statistical Psychology, 27: 229-239.
34. Sörbom, D. 1989. Model modification. Psychometrika, 54: 371-384.
35. Stoel, R. D., Garre, F. G., Dolan, C. V. and van den Wittenboer, G. 2006. On the likelihood ratio test in structural equation modeling when parameters are subject to boundary constraints. Psychological Methods, 11: 439-455.
36. Thoonen, E. E. J., Sleegers, P. J. C., Peetsma, T. T. D. and Oort, F. J. 2011. Can teachers motivate students to learn?. Educational Studies, 37: 345-360.
37. Vandenberg, R. J. and Lance, C. E. 2000. A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 2: 4-69.
38. Wicherts, J. M., Dolan, C. V., Hessen, D. J., Oosterveld, P., van Baal, G. C. M., Boomsma, D. I. and Span, M. M. 2004. Are intelligence tests measurement invariant over time? Investigating the nature of the Flynn effect. Intelligence, 32: 509-537.
39. Yuan, K. H. and Bentler, P. M. 2000. Three likelihood-based methods for mean and covariance structure analysis with nonnormal missing data. Sociological methodology, 30: 165-200.