How harmful are survey translations? A test with Schwartz's human values instrument

International Journal of Public Opinion Research

Volumn 22, Issue 4, 2010, Pages 485-510

  Davidov, Eldad ^a   De Beuckelaer, Alain ^b,c  

^a UNIVERSITY OF ZURICH   (Switzerland)

^b RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^c GHENT UNIVERSITY   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 78650096250     PISSN: 09542892     EISSN: 14716909     Source Type: Journal    
DOI: 10.1093/ijpor/edq030     Document Type: Review

References (73)

1. Acquadro, C., Jambon, B., Ellis, D., & Marquis, P. (1996). Language and translation issues. In B. Spilker (Ed.), Quality life and pharmacoeconomics in clinical trials (2nd ed., pp. 75-82). Philadelphia: Lippincott-Raven.
2. Arbuckle, J. L. (2005). Amos 6.0 user's guide. Chicago, IL: SPSS Inc.
3. Berry, J., & Sam, D. (1996). Acculturation and adaptation. In J. Berry, M. Segall & C. Kagitcibasi (Eds.), Handbook of cross-cultural psychology: Social behavior and applications (pp. 291-325). Boston, MA: Allyn & Bacon.
4. Billiet, J. (2003). Cross-cultural equivalence with structural equation modeling. In J. A. Harkness, F. J. R. Van de Vijver & P. P. Mohler (Eds.), Cross-cultural survey methods (pp. 247-264). New York, NY: John Wiley.
5. Bollen, K. A. (1989). Structural equations with latent variables. New York; NY: John Wiley.
6. Borg, I. (2000). Führungsinstrument Mitarbeiterbefragung [Management Instrument Employee Survey] (2nd ed.). Göttingen, Germany: Hogrefe.
7. Borg, I. (2003). Führungsinstrumen Mitarbeiterbefragung: Theorien, Tools und Praxisehrfahrungen [Management Instrument Employee Survey: Theories, tools, and practical experiences] (3rd ed.). Göttingen, Germany: Verlag für Angewandte Psychologie.
8. Byrne, B. M. (2001). Structural equation modeling with AMOS: Basic concepts, applications, and programming. Mahwah, NJ: Erlbaum.
9. Byrne, B. M., Shavelson, R. J., & Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456-466.
10. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait multimethod matrices. Psychological Bulletin, 56, 81-105.
11. Caprara, G. V., Barbaranelli, C., Bermúdez, J., Maslach, C., & Ruch, W. (2000). Multivariate methods for the comparison of factor structures in cross-cultural research: An illustration with the Big Five questionnaire. Journal of Cross-Cultural Psychology, 31, 437-464.
12. Chan, W., Ho, R. M., Leung, K., Chan, D. K.-S., & Yung, Y.-F. (1999). An alternative method for evaluating congruence coefficients with Procrustes rotation: A bootstrap procedure. Psychological Methods, 4, 378-402.
13. Chen, F. F. (2007). Sensitivity of goodness of fit indices to lack of measurement invariance. Structural Equation Modeling, 14, 464-504.
14. Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255.
15. Costa, P. T., Jr., & McCrae, R. R. (1992). Revised NEO Personality Questionnaire Inventory (NEO-PI-RTM) and NEO Five-Factor Inventory (NEO-FFI) professional manual. Odessa, FL: Psychological Assessment Resources.
16. Davidov, E. (2008). A cross-country and cross-time comparison of the human values measurements with the second round of the European Social Survey. Survey Research Methods, 2, 33-46.
17. Davidov, E. (2009). Measurement equivalence of nationalism and constructive patriotism in the ISSP 2003:34 countries in comparative perspective. Political Analysis, 17, 64-82.
18. Davidov, E., Schmidt, P., & Schwartz, S. (2008). Bringing values back in: Testing the adequacy of the European Social Survey to measure values in 20 countries. Public Opinion Quarterly, 72, 420-445.
19. Davidov, E., Meuleman, B., Billiet, J., & Schmidt, P. (2008). Values and support for immigration. A cross-country comparison. European Sociological Review, 24, 583-599.
20. De Beuckelaer, A. (2005). Measurement invariance issues in international management research. Unpublished doctoral dissertation, Hasselt University, Diepenbeek, Belgium.
21. De Beuckelaer, A., & Swinnen, G. (2011). Biased latent variable mean comparisons due to measurement non-invariance: A simulation study. In E. Davidov, P. Schmidt & J. Billiet (Eds.), Methods and applications in cross-cultural analysis Taylor & Francis.
22. De Beuckelaer, A., Lievens, F., & Swinnen, G. (2007). Measurement equivalence in the conduct of a global organizational survey across six cultural regions. Journal of Occupational and Organizational Psychology, 80, 575-600.
23. Feldman, S. (2003). Values, ideology, and structure of political attitudes. In D. O. Sears, L. Huddy & R. Jervis (Eds.), Oxford handbook of political psychology (pp. 477-508). New York, NY: Oxford University Press.
24. Halman, L., & De Moor, R. (1994). Value shift in Western societies. In P. Ester, L. Halman & R. de Moor (Eds.), The individualizing society: Value change in Europe and North America (pp. 1-20). Tilburg, The Netherlands: Tilburg University Press.
25. Hambleton, R. K. (2001). The next generation of the ITC test translation and adaptation guidelines. European Journal of Psychological Assessment, 17, 164-172.
26. Hambleton, R. K., & Patsula, L. (1998). Adapting tests for use in multiple languages and cultures. Social Indicators Research, 45, 153-171.
27. Harkness, J. A. (2003). Questionnaire translation. In J. A. Harkness, F. J. R. Van de Vijver & P. Ph. Mohler (Eds.), Cross-cultural survey methods (pp. 35-56). New York, NY: John Wiley.
28. Horn, J. L., & McArdle, J. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18, 117-144.
29. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
30. Hulin, C. L. (1987). A psychometric theory of evaluations of item and scale translations: Fidelity across languages. Journal of Cross-Cultural Psychology, 18, 115-142.
31. Hunt, E., & Agnoli, F. (1991). The Whorfian hypothesis: A cognitive psychology perspective. Psychological Review, 98, 377-389.
32. Inglehart, R. (1990). Culture shift in advanced industrial society. Princeton, NJ: Princeton University Press.
33. Jöreskog, K. G. (1971). Simultaneous factor analysis in several populations. Psychometrika, 36, 409-426.
34. Jowell, R., Kaase, M., Fitzgerald, R., & Eva, G. (2007). The European Social Survey as a measurement model. In R. Jowell, M. Kaase, R. Fitzgerald & G. Eva (Eds.), Measuring attitudes cross-nationally (pp. 1-29). London, UK: Sage.
35. Knoppen, D., & Saris, W. (2009). Do we have to combine values in the Schwartz' human values scale? A comment on the Davidov studies. Survey Research Methods, 3, 91-103.
36. Liu, C., Borg, I., & Spector, P. E. (2004). Measurement equivalence of the German job satisfaction survey used in a multinational organization: Implications of Schwartz's culture model. Journal of Applied Psychology, 89, 1070-1082.
37. Marsh, H. W., Hau, K.-T., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings. Structural Equation Modeling, 11, 320-341.
38. McKay, R. B., Breslow, M. J., Sangster, R. L., Gabbard, S. M., Reynolds, R. W., Nakamoto, J. M., & Tarnai, J. (1996). Translating survey questionnaires: Lessons learned. New Directions for Evaluation, 70, 93-105.
39. Meredith, W. (1993). Measurement invariance factor analysis and factorial invariance. Psychometrika, 58, 525-543.
40. Muthén, L. K., & Muthén, B. O. (2007). Mplus user's guide. Los Angeles, CA: Muthén & Muthén.
41. Oberski, D. L. (2009). Jrule for Mplus version 0.91 [computer software]. Retrieved from the Github Social Coding website: http://wiki.github.com/daob/ JruleMplus/.
42. Peytcheva, E. A. (2008). Language of administration as a source of measurement error: Implications for surveys of immigrants and cross-cultural survey research Unpublished doctoral dissertation, University of Michigan.
43. Raju, N., Lafitte, L. J., & Byrne, B. (2002). Measurement equivalence: A comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology, 87, 517-529.
44. Reise, S., Widaman, K. F., & Pugh, R. H. (1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin, 114, 552-566.
45. Rokeach, M. (1973). The nature of human values. New York, NY: Free Press.
46. Ryan, A. M., Chan, D., Ployhart, R. E., & Slade, L. A. (1999). Employee attitude surveys in a multinational organization: Considering language and culture in assessing measurement equivalence. Personnel Psychology, 52, 37-58.
47. Sagiv, L., & Schwartz, S. H. (1995). Value priorities and readiness four out-group social contact. Journal of Personality and Social Psychology, 69, 437-448.
48. Saris, W. E., & Gallhofer, I. N. (2007). Design, evaluation, and analysis of questionnaires for survey research. New York, NY: Wiley.
49. Saris, W. E., Satorra, A., & van der Veld, W. M. (2009). Testing structural equation models or detection of misspecifications? Structural Equation Modeling, 16, 561-582.
50. Schaffer, B. S., & Riordan, C. (2003). A review of cross-cultural methodologies for organizational research: A best-practices approach. Organizational Research Methods, 6, 169-215.
51. Scholderer, J., Brunsø, K., & Grunert, K. (2004). Cross-cultural validity of the food-related lifestyles instrument (FRL) within Western Europe. Appetite, 42, 197-211.
52. Schwartz, S. H. (1992). Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countries. Advances in Experimental Social Psychology, 25, 1-65.
53. Schwartz, S. H. (1994). Are there universal aspects in the content and structure of values? Journal of Social Issues, 50, 19-45.
54. Schwartz, S. H. (2003). A proposal for measuring value orientations across nations. ESS Questionnaire Development Report (chap. 7). Retrieved from: http://www.europeansocialsurvey.org.
55. Schwartz, S. H. (2005). Basic human values: Their content and structure across countries. In A. Tamayo & J. B. Porto (Eds.), Valores e comportamento nas organizações [Values and behavior in organizations] (pp. 21-55). Petrópolis, Brazil: Vozes.
56. Schwartz, S. H., & Boehnke, K. (2004). Evaluating the structure of human values with confirmatory factor analysis. Journal of Research in Personality, 38, 230-255.
57. Schwartz, S. H., Melech, G., Lehmann, A., Burgess, S., Harris, M., & Owens, V. (2001). Extending the cross-cultural validity of the theory of basic human values with a different method of measurement. Journal of Cross Cultural Psychology, 32, 519-542.
58. Smith, P. C., Kendall, L., & Hulin, C. L. (1969). The measurement of satisfaction in work and retirement. Chicago, IL: Rand McNally.
59. Smith, T. W. (2003). Developing comparable questions in cross-national surveys. In J. Harkness, F. J. R. van de Vijver & P. Möhler (Eds.), Cross-cultural survey methods (pp. 69-92). New York, NY: Wiley.
60. Sörbom, D. (1974). A general method for studying differences in factor means and factor structure between groups. British Journal of Mathematical and Statistical Psychology, 27, 229-239.
61. Sörbom, D. (1978). An alternative to the methodology for analysis of covariance. Psychometrika, 43, 381-396.
62. Stark, S., Chernyshenko, O. S., & Drasgow, F. (2006). Detecting differential item functioning with confirmatory factor analysis and item response theory: Toward a unified approach. Journal of Applied Psychology, 91, 1292-1306.
63. Steenkamp, J.-B. E. M., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25, 78-90.
64. Tourangeau, R., Rips, L. J., & Rasinski, K. (2000). Psychometric theories of survey response. Cambridge: Cambridge University Press.
65. Van de Vijver, F. J. R., & Hambleton, R. K. (1996). Translating tests: Some practical guidelines. European Psychologist, 1, 89-99.
66. Van de Vijver, F. J. R., & Leung, K. (1997). Methods and data-analysis for cross-cultural research. Thousand Oaks, CA: Sage.
67. Van der Veld, W., & Saris, W. E. (2011). Causes of generalized social trust: An innovative cross-national evaluation. In E. Davidov, P. Schmidt & J. Billiet (Eds.), cross-cultural analysis: Methods and applications. New York, NY: Routledge.
68. Van der Veld, W., Saris, W. E., & Satorra, A. (2008). Jrule 2.0: User manual. Unpublished manuscript (Internal report, Radboud University Nijmegen, The Netherlands).
69. Van den Berg, R. J. (2002). Towards a further understanding of and improvement in measurement invariance methods and procedures. Organizational Research Methods, 5, 139-158.
70. Van den Berg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4-69.
71. Weech-Maldonado, R., Weidmer, B. O., Morales, L. S., & Hays, R. D. (2001). Cross-cultural adaptation of survey instruments. The CAHPS experience. In N. Cynamon & R. Kulka (Eds.), Proceedings of the Seventh Conference on Health Survey Research Methods. Hyattsville, MD: DHHS.
72. Weidmer, B. (2000). Designing and adapting health surveys for cross-cultural research. Paper presented at the 24th Annual Meeting of the Society of General Internal Medicine, San Diego, CA.
73. Whorf, B. L. (1956). Language, thought, and reality: Selected writings of Benjamin Lee Whorf. New York, NY: Wiley.