What Happens If We Compare Chopsticks With Forks? The Impact of Making Inappropriate Comparisons in Cross-Cultural Research

Journal of Personality and Social Psychology

Volumn 95, Issue 5, 2008, Pages 1005-1018

  Chen, Fang Fang ^a  

^a UNIVERSITY OF DELAWARE   (United States)

Author keywords

bias in regression slopes and means; construct equivalence; cross cultural comparison; measurement invariance; self esteem

Indexed keywords

ARTICLE; CHINA; COMPARATIVE STUDY; CULTURAL FACTOR; EPIDEMIOLOGY; HUMAN; PERSONALITY TEST; PSYCHOLOGICAL ASPECT; PSYCHOMETRY; QUALITY OF LIFE; REFERENCE VALUE; RESEARCH; SELF CONCEPT; STATISTICS; UNITED STATES;

BIAS (EPIDEMIOLOGY); CHINA; CROSS-CULTURAL COMPARISON; HUMANS; PERSONALITY INVENTORY; PSYCHOMETRICS; QUALITY OF LIFE; REFERENCE VALUES; RESEARCH; SELF CONCEPT; UNITED STATES;

EID: 56349088295     PISSN: 00223514     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0013193     Document Type: Article

References (53)

1. Berry J.W. On cross-cultural comparability. International Journal of Psychology 2 (1969) 119-128
2. Bollen K.A. Structural equations with latent variables (1989), Wiley, New York
3. Brewer M.B., and Chen Y.-R. Where (who) are collectives in collectivism? Toward conceptual clarification of individualism and collectivism. Psychological Review 114 (2007) 133-151
4. Byrne B.M., and Campbell T.L. Cross-cultural comparisons and the presumption of equivalent measurement and theoretical structure: A look beneath the surface. Journal of Cross-Cultural Psychology 30 (1999) 555-574
5. Byrne B., Shavelson R., and Muthen B. Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin 105 (1989) 456-466
6. Byrne B.M., and Watkins D. The issue of measurement invariance revisited. Journal of Cross-Cultural Psychology 34 (2003) 155-175
7. Campbell D.T., and Boruch R.F. Making the case for randomized assignment to treatments by considering the alternatives: Six ways in which quasi-experimental evaluations in compensatory education tend to underestimate effects. In: Bennett C.A., and Lumsdaine A.A. (Eds). Evaluation and experiment: Some critical issues in assessing social programs (1975), Academic Press, New York 195-296
8. Chen C., Lee S.Y., and Stevenson H.W. Response style and cross-cultural comparisons of rating scales among East Asian and North American students. Psychological Science 6 (1995) 170-175
9. Chen F.F. Sensitivity of goodness of fit indices to lack of measurement invariance. Structural Equation Modeling 14 (2007) 464-504
10. Chen F.F., Sousa K.H., and West S.G. Testing measurement invariance of second-order factor models. Structural Equation Modeling 12 (2005) 471-492
11. Chen F.F., and West S.G. Measuring individualism and collectivism: The importance of considering different components, reference groups, and measurement invariance. Journal of Research in Personality 42 (2008) 259-294
12. Cheung G.W., and Rensvold R.B. Cross-cultural comparisons using non-invariant measurement items. Applied Behavioral Science Review 6 (1998) 93-110
13. Cheung G.W., and Rensvold R.B. Assessing extreme and acquiescence response sets in cross-cultural research using structural equation modeling. Journal of Cross-Cultural Research 31 (2000) 187-212
14. Costa P.T., and McCrae R.R. Professional manual: Revised NEO Personality Inventory (NEO PI-R) and NEO five factor inventory (NEO-FFI) (1992), Psychological Assessment Resources, Odessa, FL
15. Diener E., Emmons R.A., Larsen R.J., and Griffin S. The Satisfaction With Life Scale. Journal of Personality Assessment 49 (1985) 71-75
16. Embretson S.E., and Reise S.P. Item response theory for psychologists (2000), Erlbaum, Mahwah, NJ
17. Fiske A.P., Kitayama S., Markus H.R., and Nisbett R.E. The cultural matrix of social psychology. In: Gilbert D.T., Fiske S.T., and Linzey G. (Eds). Handbook of social psychology. 4th ed. (1998), McGraw-Hill, Boston 915-981
18. Heine S.J., Lehman D.R., Markus H.R., and Kitayama S. Is there a universal need for positive self-regard?. Psychological Review 106 (1999) 766-794
19. Heine S.J., Lehman D.R., Peng K., and Greenholtz J. What's wrong with cross-cultural comparisons of subjective Likert scales? The reference group effect. Journal of Personality and Social Psychology 82 (2002) 903-918
20. Holland P.W., and Thayer D.T. Differential item performance and the Mantel-Haenszel procedure. In: Wainer H., and Braum H. (Eds). Test validity (1988), Erlbaum, Hillsdale, NJ 129-145
21. Horn J.L., McArdle J.J., and Mason R. When is invariance not invariant: A practical scientist's look at the ethereal concept of factor invariance. Southern Psychologist 4 (1983) 179-188
22. Hsieh Y.-W. Filial piety and Chinese society. In: Moore C.A. (Ed). The Chinese mind: Essentials of Chinese philosophy and culture (1967), University of Hawaii Press, Honolulu 165-187
23. Hui C.H., and Triandis H.C. Measurement in cross-cultural psychology: A review and comparison of strategies. Journal of Cross-Cultural Psychology 16 (1985) 131-152
24. Irvine S.H., and Carroll W.K. Testing and assessment across cultures: Issues in methodology and theory. In: Triandis H.C., and Berry J.W. (Eds). Handbook of cross-cultural psychology 2 (1980), Allyn & Bacon, Newton, MA 181-244
25. Jöreskog K.G. Simultaneous factor analysis in several populations. Psychometrika 36 (1971) 409-426
26. Jöreskog K.G., and Sörbom D. LISREL 8: User's reference guide. 2nd ed. (1999), Scientific Software International, Chicago
27. Kwan V.S.Y., Bond M.H., Boucher H.C., Maslach C., and Gan Y. The construct of individuation: More complex in collectivist than in individualist cultures. Personality and Social Psychology Bulletin 28 (2002) 300-310
28. Lehman D., Chiu C., and Schaller M. Psychology and culture. Annual Review of Psychology 55 (2004) 689-717
29. Little T.D. Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research 32 (1997) 53-76
30. Markus H.R., and Kitayama S. Culture and self: Implications for cognition, emotion, and motivation. Psychological Review 98 (1991) 224-253
31. Maslach C., Stapp J., and Santee R.T. Individuation: Conceptual analysis and assessment. Journal of Personality and Social Psychology 49 (1985) 729-738
32. McArdle J.J., and Cattell R.B. Structural equation models of factorial invariance in parallel proportional profiles and oblique confactor problems. Multivariate Behavioral Research 29 (1994) 63-113
33. Meredith W. Measurement invariance, factor analysis and factorial invariance. Psychometrika 58 (1993) 525-543
34. Millsap R.E. Four unresolved problems in studies of factorial invariance. In: Maydeu-Olivares A., and McArdle J. (Eds). Contemporary psychometrics: A festschrift for Roderick P. McDonald: Multivariate applications book series (2005), Erlbaum, Mahwah, NJ 153-171
35. Millsap R.E., and Everson H.T. Methodology review: Statistical approaches for assessing measurement bias. Applied Psychological Measurement 17 (1993) 297-334
36. Millsap R.E., and Kwok O.-M. Evaluating the impact of partial factorial invariance on selection of multiple populations. Psychological Methods 9 (2004) 93-115
37. Moorman R.H., and Podsakoff P.M. A meta-analytic review and empirical test of the potential confounding effects of social desirability response sets in organizational behavior research. Journal of Occupational and Organizational Psychology 65 (1992) 131-149
38. Muthén L.K., and Muthén B.O. Mplus user's guide (1998), Muthén & Muthén, Los Angeles
39. Oishi S., and Sullivan H.W. The mediating role of parental expectations in culture and well-being. Journal of Personality 73 (2005) 1267-1294
40. Oyserman D., Coon H.M., and Kemmelmeier M. Rethinking individualism and collectivism: Evaluation of theoretical assumptions and meta-analyses. Psychological Bulletin 128 (2002) 3-72
41. Peng K., Nisbett R.E., and Wong N.Y. Validity problems comparing values across cultures and possible solutions. Psychological Methods 2 (1997) 329-344
42. Poortinga Y.H. Equivalence of cross-cultural data: An overview of basic issues. International Journal of Psychology 24 (1989) 737-756
43. Reise S.P., Widaman K.F., and Pugh R.H. Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin 114 (1993) 552-566
44. Rhee E., Uleman J.S., and Lee H.K. Variations in collectivism and individualism by ingroup and culture: Confirmatory factor analysis. Journal of Personality and Social Psychology 71 (1996) 1037-1054
45. Riordan C.M., and Vanderberg R.J. A central question in cross-cultural research: Do employees of different cultures interpret work-related measures in an equivalent manner?. Journal of Management 20 (1994) 643-671
46. Rosenberg M. Society and the adolescent self-image (1965), Princeton University Press, Princeton, NJ
47. Smith L.L., and Reise S.P. Gender differences on negative affectivity: An IRT study of differential item functioning on the Multidimensional Personality Questionnaire Stress Reaction Scale. Journal of Personality and Social Psychology 75 (1999) 1350-1362
48. Sörbom D. An alternative to the methodology for analysis of covariance. Psychometrika 43 (1978) 381-396
49. Steenkamp J.E.M., and Baumgartner H. Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research 25 (1998) 78-90
50. Ullman J.B. Structural equation modeling. In: Tabachnick B.G., and Fidell L.S. (Eds). Using multivariate statistics (2001), Allyn & Bacon, Boston 653-771
51. Van de Vijver F.J.R., and Leung K. Methods and data analysis for comparative research. In: Berry J., Poortinga Y., and Pandey J. (Eds). Handbook of cross-cultural psychology 1 (1997), Allyn & Bacon, Boston 259-300
52. Van de Vijver F., and Leung K. Methodological issues in psychological research on culture. Journal of Cross-Cultural Psychology 31 (2000) 33-51
53. Widaman K.F., and Reise S.P. Exploring the measurement invariance of psychological instruments: Applications in the substance use domain. In: Bryant K.J., Windle M., and West S.G. (Eds). The science of prevention: Methodological advances from alcohol and substance abuse research (1997), American Psychological Association, Washington, DC 281-324