Using a Multilevel Structural Equation Modeling Approach to Explain Cross-Cultural Measurement Noninvariance

Journal of Cross-Cultural Psychology

Volumn 43, Issue 4, 2012, Pages 558-575

  Davidov, Eldad ^a   Dülmer, Hermann ^b   Schlüter, Elmar ^b   Schmidt, Peter ^c   Meuleman, Bart ^d  

^a UNIVERSITY OF ZURICH   (Switzerland)

^b UNIVERSITY OF COLOGNE   (Germany)

^c NATIONAL RESEARCH UNIVERSITY HIGHER SCHOOL OF ECONOMICS   (Russian Federation)

^d UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

and Scalar invariance; Comparisons over time and or countries; Configural; European social survey; Metric; Multilevel confirmatory factor analysis (CFA) Multilevel structural equation modeling (SEM)

Indexed keywords

EID: 84859866261     PISSN: 00220221     EISSN: 15525422     Source Type: Journal    
DOI: 10.1177/0022022112438397     Document Type: Article

References (65)

1. Ariely G.,Davidov E.Can we rate public support for democracy in a comparable way? Cross-national equivalence of democratic attitudes in the World Value Survey.Social Indicators Research. 2010;104 (2): 271-286.
2. Billiet J.Cross-cultural survey methods. Harkness J. A.Van de Vijver F. J. R.Mohler P. P., ed. New York: John Wiley; 2003:247-264.
3. Bollen K. A.Structural equations with latent variables. New York: Wiley; 1989:.
4. Brown T. A.Confirmatory factor analysis for applied research. New York: Guilford Press; 2006:.
5. Byrne B. M.Structural equation modeling with AMOS: Basic concepts, applications, and programming. Mahwah, NJ: Erlbaum; 2001:.
6. Byrne B. M.,Shavelson R. J.,Muthén B.Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance.Psychological Bulletin. 1989;105:456-466.
7. Byrne B. M.,van de Vijver F.Testing for measurement and structural equivalence in large-scale cross-cultural studies: Addressing the issue of nonequivalence.International Journal of Testing. 2010;10:107-132.
8. Chen F. F.Sensitivity of goodness of fit indices to lack of measurement invariance.Structural Equation Modeling. 2007;14:464-504.
9. Cheung G. W.,Rensvold R. B.Evaluating goodness-of-fit indexes for testing measurement invariance.Structural Equation Modeling. 2002;9:233-255.
10. Cheung M. W.- L.,Au K.Applications of multilevel structural equation modeling to cross-cultural research.Structural Equation Modeling. 2005;12 (4): 598-619.
11. Cheung M. W.- L.,Leung K.,Au K.Evaluating multilevel models in cross-cultural research: An illustration with social axioms.Journal of Cross-Cultural Psychology. 2006;37 (5): 522-541.
12. Coleman J. S.Foundations of social theory. Cambridge, MA: Harvard University Press; 1994:.
13. Davidov E.A cross-country and cross-time comparison of the human values measurements with the second round of the European Social Survey.Survey Research Methods. 2008;2 (1): 33-46.
14. Davidov E.Measurement equivalence of nationalism and constructive patriotism in the ISSP: 34 countries in a comparative perspective.Political Analysis. 2009;17 (1): 64-82.
15. Davidov E.,Schmidt P.,Billiet J.Cross-cultural analysis: Methods and applications. New York: Routledge; 2011:.
16. Davidov E.,Schmidt P.,Schwartz S. H.Bringing values back in. The adequacy of the European Social Survey to measure values in 20 countries.Public Opinion Quarterly. 2008;72 (3): 420-445.
17. De BeuckelaerA. (2005). Measurement invariance issues in international management research. Unpublished dissertation, Limburgs University Centrum, Centrum, Limburg, the Netherlands.
18. De Beuckelaer A.,Lievens F.,Swinnen G.Measurement equivalence in the conduct of a global organizational survey across six cultural regions.Journal of Occupational and Organizational Psychology. 2007;80:575-600.
19. De Beuckelaer A.,Swinnen G.Cross-cultural research: Methods and applications. Davidov E.Schmidt P.Billiet J., ed. New York: Routledge; 2011:117-147.
20. Fischer R.,Milfont T. L.,Gouveia V. V.Does social context affect value structures? Testing the within-country stability of value structures with a functional theory of values.Journal of Cross-Cultural Psychology. 2011;42 (2): 253-270.
21. Fontaine J. R. J.Multilevel analysis of individuals and cultures. van de Vijver F. J. R.van Hemert D. A.Poortinga Y. H., ed. New York: Lawrence Erlbaum Associates; 2008:65-92.
22. Fontaine J. R. J.,Poortinga Y. H.,Delbeke L.,Schwartz S.Structural equivalence of the values domain across cultures: Distinguishing sampling fluctuations from meaningful variation.Journal of Cross-Cultural Psychology. 2008;39 (4): 345-365.
23. Cross-cultural survey methods. Harkness J. A.van de Vijver F. J. R.Mohler P. P., ed. New York: John Wiley; 2003:.
24. Horn J. L.,McArdle J. J.A practical and theoretical guide to measurement invariance in aging research.Experimental Aging Research. 1992;18:117-144.
25. Hox J.Multilevel analysis: Techniques and applications. Mahwah, NJ: Lawrence Erlbaum; 2002:.
26. Hox J. J.,de Leeuw E. D.,Brinkhuis M. J.Survey methods in multinational, multiregional, and multicultural contexts. Harkness J. A.Braun M.Edwards B.Johnson T. P.Lyberg L.Mohler P. P.Pennell B.- E.Smith T. W., ed. Hoboken, NJ: John Wiley; 2010:395-418.
27. HoxJ. J.van de SchootR.MatthijsseS. (2011). How few countries will do? Comparative survey analysis from a Bayesian perspective. Unpublished manuscript.
28. Hu L.,Bentler P. M.Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives.Structural Equation Modeling. 1999;6:1-55.
29. Hui C. H.,Triandis H. C.Measurement in cross-cultural psychology: A review and comparison of strategies.Journal of Cross-Cultural Psychology. 1985;16:131-152.
30. Inglehart R.Culture shift in advanced industrial society. Princeton, NJ: Princeton University Press; 1990:.
31. Inglehart R.Modernization and postmodernization: Cultural, economic, and political change in 43 societies. Princeton, NJ: Princeton University Press; 1997:.
32. Jak S.,Oort F. J.,Dolan C. V. Paper presented at the Structural Equation Modeling Working Group, Marburg; 2011Germany; 2011.
33. Jöreskog K. G.Simultaneous factor analysis in several populations.Psychometrika. 1971;36:409-426.
34. Lee J.,Little T. D.,Preacher K. J.Cross-cultural research: Methods and applications. Davidov E.Schmidt P.Billiet J., ed. New York: Routledge; 2011:55-84.
35. Marsh H. W.,Hau K.- T.,Wen Z.In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings.Structural Equation Modeling. 2004;11:320-341.
36. Maslow A. H.Motivation and personality. New York: Harper & Brothers; 1954:.
37. Medina T. R.,Smith S. N.,Long J. S.Measurement models matter: Implicit assumptions and cross-national research.International Journal of Public Opinion Research. 2009;21 (3): 333-361.
38. Meredith W.Measurement invariance, analysis and factorial invariance.Psychometrika. 1993;58:525-543.
39. Meuleman B.,Billiet J.A Monte Carlo sample size study: How many countries are needed for accurate multilevel SEM?.Survey Research Methodology. 2009;3 (1): 45-58.
40. Meuleman B.,Davidov E.,Billiet J.Changing attitudes toward immigration in Europe, 2002-2007. A dynamic group conflict theory approach.Social Science Research. 2009;38 (2): 352-365.
41. Muthén B. O.A method for studying the homogeneity of test items with respect to other relevant variables.Journal of Educational Statistics. 1985;10 (2): 121-132.
42. Muthén B. O.Latent variable modeling in heterogeneous populations.Psychometrika. 1989;54:557-585.
43. Muthén B. O.Multilevel factor analysis of class and student achievement components.Journal of Educational Measurement. 1991;28:338-354.
44. Muthén B. O.Multilevel covariance structure analysis.Sociological Methods & Research. 1994;22 (3): 376-398.
45. Muthén L. K.,Muthén B. O.Mplus user's guide. Los Angeles, CA: Muthén & Muthén; 1998-2010:.
46. Oort F. J.Using restricted factor analysis to detect item bias.Methodika. 1992;6:150-166.
47. Oort F. J.Simulation study of item bias detection with restricted factor analysis.Structural Equation Modeling. 1998;5:107-124.
48. Poortinga Y. H.Equivalence of cross-cultural data: An overview of basic issues.International Journal of Psychology. 1989;24:737-756.
49. Saris W. E.,Satorra A.,Sörbom D.The detection and correction of specification errors in structural equation models.Sociological Methodology. 1987;17:105-129.
50. Saris W. E.,Satorra A.,van der Veld W. M.Testing structural equation models or detection of misspecifications?.Structural Equation Modeling. 2009;16:561-582.
51. Schlüter E.,Meuleman B. Paper presented at the 3rd ESRA Conference Warsaw, Poland; 2009.
52. Schwartz S. H.Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countries.Advances in Experimental Social Psychology. 1992;25:1-65.
53. Schwartz S. H.Are there universal aspects in the content and structure of values?.Journal of Social Issues. 1994;50:19-45.
54. Schwartz S. H.,Melech G.,Lehmann A.,Burgess S.,Harris M.,Owens V.Extending the cross-cultural validity of the theory of basic human values with a different method of measurement.Journal of Cross Cultural Psychology. 2001;32:519-542.
55. Selig J. P.,Card N. A.,Little T. D.Individuals and cultures in multi-level analysis. van de Vijver F. J. R.van Hemert D. A.Poortinga Y. H., ed. Mahwah, NJ: Lawrence Erlbaum Associates; 2008:93-119.
56. Sörbom D.A general method for studying differences in factor means and factor structure between groups.British Journal of Mathematical and Statistical Psychology. 1974;27:229-239.
57. Sörbom D.An alternative to the methodology for analysis of covariance.Psychometrika. 1978;43:381-396.
58. Steenkamp J.- B. E. M.,Baumgartner H.Assessing measurement invariance in cross-national consumer research.Journal of Consumer Research. 1998;25:78-90.
59. Stegmueller D. Paper presented at the 4th conference of the European Survey Research Association, Lausanne, Switzerland 2011.
60. Steinmetz H.,Schmidt P.,Tina-Booh A.,Wieczorek S.,Schwartz S. H.Testing measurement invariance using multigroup CFA: Differences between educational groups in human values measurement.Quality & Quantity. 2009;43:599-616.
61. United Nations Development Program. (2006). Human Development Report 2006. Beyond scarcity: Power, poverty and the global water crisis. Retrieved February 8, 2009, from http://hdr.undp.org/en/reports/global/hdr2006/chapters/.
62. Vandenberg R. J.,Lance C. E.A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research.Organizational Research Methods. 2000;3:4-69.
63. Van der Veld W.,Saris W. E.Cross-cultural analysis: Methods and applications. Davidov E.Schmidt P.Billiet J., ed. New York: Routledge; 2011:207-247.
64. Welkenhuysen-GybelsJ. (2003). The detection of differential item functioning in Likert score items (unpublished doctoral dissertation). Leuven, Belgium: KU Leuven.
65. Welkenhuysen-Gybels J.,van de Vijver F.,Cambré B.Measuring meaningful data in social research. Loosveldt G.Swyngedouw M.Cambré B., ed. Leuven, Belgium: Acco; 2007:357-372.