Assessment of measurement equivalence with cross-national and longitudinal surveys in political science

European Political Science

Volumn 11, Issue 3, 2012, Pages 363-377

  Ariely, Gal ^a   Davidov, Eldad ^b  

^a UNIVERSITY OF NOTRE DAME   (United States)

^b UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

cross national and longitudinal surveys; measurement equivalence; multiple group confirmatory factor analysis (MGCFA)

Indexed keywords

EID: 84865182900     PISSN: 16804333     EISSN: 16820983     Source Type: Journal    
DOI: 10.1057/eps.2011.11     Document Type: Review

References (60)

1. Adcock, R. and Collier, D. (2001) 'Measurement validity: A shared standard for qualitative and quantitative research', American Political Science Review 95(3): 529-546.
2. Almond, G.A. and Verba, S. (1963) The Civic Culture: Political Attitudes and Democracy in Five Nations, Princeton: Princeton University Press.
3. Anderson, C.J. and Tverdova, Y.V. (2003) 'Corruption, political allegiances, and attitudes toward government in contemporary democracies', American Journal of Political Science 47: 91-109. (Pubitemid 36532752)
4. Arbuckle, J.L. (2007) Amos 16.0 User's Guide, Chicago: SPSS.
5. Ariely, G. and Davidov, E. (2010) 'Can we rate public support for democracy in a comparable way? Crossnational equivalence of democratic attitudes in the world value survey', Social Indicators Research, doi: 10.1007/s11205-010-9693-5.
6. Billiet, J. (2003) 'Cross-Cultural Equivalence with Structural Equation Modeling', in J.A. Harkness, F.J.R. Van de Vijver and P.H. Mohler (eds.) Cross-Cultural Survey Methods, New York: John Wiley & Sons, pp. 247-264.
7. Blekesaune, M. and Quadagno, J. (2003) 'Public attitudes toward welfare state policies. A comparative analysis of 24 nations', European Sociological Review 19(5): 415-427. (Pubitemid 37528383)
8. Bollen, K.A. (1989) Structural Equations with Latent Variables, New York: Wiley.
9. Brown, T.A. (2006) Confirmatory Factor Analysis for Applied Research: Methodology in the Social Sciences, New York: Guilford Press.
10. Byrne, B.M. (2010) Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming, 2nd edn., New York: Routledge.
11. Byrne, B.M., Shavelson, R.J. and Muthén, B. (1989) 'Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance', Psychological Bulletin 105(3): 456-466.
12. Byrne, B.M. and Stewart, S.M. (2006) 'The MACS approach to testing for multigroup invariance of a second-order structure: A walk through the process', Structural Equation Modeling 13(2): 287-321. (Pubitemid 43812912)
13. Chen, F.F. (2007) 'Sensitivity of goodness of fit indexes to lack of measurement invariance', Structural Equation Modeling 14(3): 464-504.
14. Cheung, G.W. and Rensvold, R.B. (2002) 'Evaluating goodness-of-fit indexes for testing measurement invariance', Structural Equation Modeling 9(2): 233-255.
15. Davidov, E. (2008) 'A cross-country and cross-time comparison of the human values measurements with the second round of the European social survey', Survey Research Methods 2(1): 33-46.
16. Davidov, E. (2009) 'Measurement equivalence of nationalism and constructive patriotism in the ISSP: 34 countries in a comparative perspective', Political Analysis 17(1): 64-82.
17. Davidov, E. (2010a) 'Testing for comparability of human values across countries and time with the third round of the European social survey', International Journal of Comparative Sociology 51(3): 171-191.
18. Davidov, E. (2010b) 'Nationalism and patriotism: A longitudinal analysis in 22 countries with the ISSP', International Journal of Public Opinion Research, 22(4): 485-510.
19. Davidov, E., Datler, G., Schmidt, P. and Schwartz, S.H. (2011a) 'Testing the Invariance of Values in the Benelux Countries with the European Social Survey: Accounting for Ordinality', in E.
20. Davidov, P. Schmidt and J. Billiet (eds.) Cross-Cultural Analysis: Methods and Applications, New Jersey: Routledge.
21. Davidov, E. and De Beuckelaer, A. (2010) 'Testing the equivalence of an instrument to assess Schwartz' human values: How harmful are translations?' International Journal of Public Opinion Research, doi: 10.1093/ijpor/edq030.
22. Davidov, E., Schmidt, P. and Billiet, J. (2011b) Cross-Cultural Analysis: Methods and Applications, New Jersey: Routledge.
23. Davidov, E., Schmidt, P. and Schwartz, S.H. (2008) 'Bringing values back in: The adequacy of the European social survey to measure values in 20 countries', Public Opinion Quarterly 72(3): 420-445.
24. De Beuckelaer, A. (2005) 'Measurement invariance issues in international management research', Ph.D. dissertation, Limburgs Universitie Centrum, Limburg, the Netherlands.
25. Evans, G. (2007) 'Britain and Europe: Separate worlds of welfare?' Government and Opposition 33(2): 183-198.
26. Harkness, J.A., Braun, M., Edwards, B., Johnson, T.P., Lyberg, L., Mohler, P.Ph., Pennell, B.-E. and Smith, T.W. (2010) Survey Methods in Multicultural, Multinational, and Multiregional Contexts, New York:Wiley.
27. Harkness, J., Pennell, B.-E. and Schoua-Glusberg, A. (2004) 'Survey Questionnaire Translation and Assessment', in S. Presser et al (eds.) Methods for Testing and Evaluating Survey Questionnaires, New York: Wiley, pp. 453-473.
28. Harkness, J.A., Van de Vijver, F.J.R. and Mohler, P.P. (2003) Cross-Cultural Survey Methodology, New York: Wiley.
29. Heath, A., Fisher, S. and Smith, S. (2005) 'The globalization of public opinion research', Annual Review of Political Science 8: 297-333. (Pubitemid 40977456)
30. Horn, J.L. and McArdle, J.J. (1992) 'A practical and theoretical guide to measurement invariance in aging research', Experimental Aging Research 18(3): 117-144.
31. Hu, L. and Bentler, P.M. (1999) 'Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives', Structural Equation Modeling 6(4): 1-55.
32. Hui, C.H. and Triandis, H.C. (1985) 'Measurement in cross-cultural psychology: A review and comparison of strategies', Journal of Cross-Cultural Psychology 16(2): 131-152.
33. Jöreskog, K.G. (1971) 'Simultaneous factor analysis in several populations', Psychometrika 36(4): 409-426.
34. Jöreskog, K.G. and Sörbom, D. (2001) Lisrel 8: User's Reference Guide, Chicago: Scientific Software International.
35. Jowell, R., Roberts, C., Fitzgerald, R. and Gillian, E. (eds.) (2007) Measuring Attitudes Cross-Nationally: Lessons from the European Social Survey, London: Sage Publications.
36. King, G., Murray, C.J.L., Salomon, J.A. and Tandon, A. (2004) 'Enhancing the validity and cross-cultural comparability of measurement in survey research', American Political Science Review 97(4): 567-583.
37. Kittilson, M.C. (2007) 'Research Resources in Comparative Political Behavior', in J.R. Dalton and H. Klingemann (eds.) Oxford Handbook of Political Behavior, Oxford: Oxford University Press, pp. 865-895.
38. Lipsmeyer, C. and Nordstrom, T. (2003) 'East versus west: Comparing political attitudes and welfare preferences across European societies', Journal of European Public Policy 10(3): 339-364.
39. Lubke, G.H. and Muthén, B.O. (2004) 'Applying multigroup confirmatory factor models for continuous outcomes to Likert scale data complicates meaningful group comparisons', Structural Equation Modeling 11(4): 514-534. (Pubitemid 39477205)
40. Marsh, H., Hau, K.T. and Wen, Z. (2004) 'In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings', Structural Equation Modeling 11(3): 320-341. (Pubitemid 38874703)
41. Meredith, W. (1993) 'Measurement invariance, factor analysis and factorial invariance', Psychometrika 58(4): 525-543.
42. Meuleman, B., Davidov, E. and Billiet, J. (2009) 'Changing attitudes toward immigration in Europe, 2002-2007. A dynamic group conflict theory approach', Social Science Research 38(2): 352-365.
43. Muthén, L.K. and Muthén, B.O. (2007) Mplus User's Guide, Los Angeles, CA: Muthén & Muthén.
44. Norris, P. (2009) 'The Globalization of Comparative Public Opinion Research', in T. Landman and N. Robinson (eds.) The Sage Handbook of Comparative Politics, London: Sage, pp. 522-540.
45. Papadakis, E. and Bean, B. (1993) 'Popular support for the welfare state: A comparison between institutional regimes', Journal of Public Policy 13(3): 227-254.
46. Raykov, T. (1997) 'Scale reliability Cronbach's coefficient alpha, and violations of essential tauequivalence with fixed congeneric components', Multivariate Behavioral Research 32(4): 329-353. (Pubitemid 127341623)
47. Reeskens, T. and Hooghe, M. (2008) 'Cross-cultural measurement equivalence of generalized trust. Evidence from the European social survey (2002 and 2004)', Social Indicators Research 85(3): 515-532. (Pubitemid 350214722)
48. Saris, W.E., Satorra, A. and Van der Veld, W. (2009) 'Testing structural equation models or detection of misspecifications?' Structural Equation Modeling 16: 561-582.
49. Schafer, J.L. and Graham, J.W. (2002) 'Missing data: Our view of the state of the art', Psychological Methods 7(2): 147-177.
50. Sijtsma, K. (2009) 'On the use, the misuse, and the very limited usefulness of Cronbach's alpha', Psychometrika 74(1): 107-120.
51. Steenkamp, J.-B.E.M. and Baumgartner, H. (1998) 'Assessing measurement invariance in cross-national consumer research', Journal of Consumer Research 25(1): 78-107.
52. Svallfors, S. (2004) 'Class, attitudes and the welfare state: Sweden in comparative perspective', Social Policy and Administration 38(2): 119-138. (Pubitemid 38423336)
53. Svallfors, S. (2006) The Moral Economy of Class: Class and Attitudes in Comparative Perspective, Stanford, CA: Stanford University Press.
54. Van Deth, J.W. (2009) 'Establishing Equivalence', in T. Landman and N. Robinson (eds.) The SAGE Handbook of Comparative Politics, London: Sage Publications, pp. 84-100.
55. Van de Vijver, F.J.R. (2003a) 'Bias and Equivalence: Cross-Cultural Perspective', in J.A. Harkness, F.J.R. Van de Vijver and P.H. Mohler (eds.) Cross-Cultural Survey Methods, New York: John Wiley & Sons, pp. 143-155.
56. Van de Vijver, F.J.R. (2003b) 'Bias and Substantive Analyses', in J.A. Harkness, F.J.R. Van de Vijver and P.H. Mohler (eds.) Cross-Cultural Survey Methods, New York: John Wiley & Sons, pp. 207-233.
57. Van der Veld, W. and Saris, W.E. (2011) 'Methodological Aspects of the Cross-National Evaluation of a Theory on the Causes of Generalized Social Trust', in E. Davidov, P. Schmidt and J. Billiet (eds.) Cross-Cultural Analysis: Methods and Applications, New York: Routledge.
58. Vandenberg, R.J. and Lance, C.E. (2000) 'A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research', Organizational Research Methods 3(1): 4-70.
59. Welkenhuysen-Gybels, J. (2004) 'The performance of some observed and unobserved conditional invariance techniques for the detection of differential item functioning', Quality & Quantity 38(6): 681-702.
60. Welkenhuysen-Gybels, J. and Billiet, J. (2002) 'A comparison of techniques for detecting cross-cultural inequivalence at the item level', Quality & Quantity 36(3): 197-218. (Pubitemid 37132937)