Are cross-cultural comparisons of personality profiles meaningful? Differential item and facet functioning in the revised NEO personality inventory

Journal of Personality and Social Psychology

Volumn 101, Issue 5, 2011, Pages 1068-1089

  Church, A Timothy ^a   Alvarez, Juan M ^a   Mai, Nhu T Q ^a   French, Brian F ^a   Katigbak, Marcia S ^a   Ortiz, Fernando A ^b  

^a WASHINGTON STATE UNIVERSITY   (United States)

^b GONZAGA UNIVERSITY   (United States)

Author keywords

Cross cultural comparisons; Differential item functioning; Measurement invariance; Revised NEO Personality Inventory

Indexed keywords

ADULT; ARTICLE; COMPARATIVE STUDY; CULTURAL FACTOR; FEMALE; HUMAN; MALE; MEXICO; PERSONALITY; PERSONALITY TEST; PHILIPPINES; PHYSIOLOGY; STANDARD; STATISTICS; UNITED STATES;

ADULT; CROSS-CULTURAL COMPARISON; FEMALE; HUMANS; MALE; MEXICO; PERSONALITY; PERSONALITY INVENTORY; PHILIPPINES; UNITED STATES; YOUNG ADULT;

EID: 82855182205     PISSN: 00223514     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0025290     Document Type: Article

References (86)

1. Allik J., McCrae R.R. Toward a geography of personality traits: Patterns of profiles across 36 cultures. Journal of Cross-Cultural Psychology 2004, 35:13-28. 10.1177/0022022103260382.
2. Benet-Martinez V., John O.P. Los cinco grandes across culture and ethnic groups: Multitrait multimethod analysis of the Big Five in Spanish and English. Journal of Personality and Social Psychology 1998, 75:729-750.
3. Bentler P.M. Comparative fit indexes in structural models. Psychological Bulletin 1990, 107:238-246. 10.1037/0033-2909.107.2.238.
4. Berry J.W. On cross-cultural comparability. International Journal of Psychology 1969, 4:119-128. 10.1080/00207596908247261.
5. Bock P.K. Culture and personality revisited. American Behavioral Scientist 2000, 44:32-40. 10.1177/00027640021956071.
6. Bollen K.A. Structural equations with latent variables 1989, John Wiley, New York, NY.
7. Brown T.A. Confirmatory factor analysis for applied research 2006, Guilford Press, New York, NY.
8. Butcher J.N. International adaptations of the MMPI-2 1996, University of Minnesota Press, Minneapolis.
9. Byrne B.M., Shavelson R.J., Muthén B. Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin 1989, 105:456-466. 10.1037/0033-2909.105.3.456.
10. Camilli G., Shepard L.A. Methods for identifying biased test items 1994, Vol. 4. Sage, Thousand Oaks, CA.
11. Camperio Ciani A.S., Capiluppi C., Veronese A., Sartori G. The adaptive value of personality differences revealed by small island population dynamics. European Journal of Personality 2007, 21:3-22. 10.1002/per.595.
12. Cattell R.B., Cattell A.K., Cattell H.E.P. Sixteen Personality Factor Questionnaire 1993, Institute for Personality and Ability Testing, Champaign, IL. 5th ed.
13. Cheung F.M., Cheung S.F., Wada S., Zhang J. Indigenous measures of personality assessment in Asian countries: A review. Psychological Assessment 2003, 15:280-289. 10.1037/1040-3590.15.3.280.
14. Cheung G.W., Rensvold R.B. Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal 2002, 9:233-255. 10.1207/S15328007SEM0902_5.
15. Church A.T. Personality research in a non-Western culture: The Philippines. Psychological Bulletin 1987, 102:272-292. 10.1037/0033-2909.102.2.272.
16. Church A.T. Personality measurement in cross-cultural perspective. Journal of Personality 2001, 69:979-1006. 10.1111/1467-6494.696172.
17. Church A.T. Current controversies in the study of personality across cultures. Social and Personality Psychology Compass 2008, 2:1930-1951. 10.1111/j.1751-9004.2008.00132.x.
18. Church A.T. Measurement issues in cross-cultural research. The Sage handbook of measurement 2010, 151-177. Sage Publications, Thousand Oaks, CA. G. Walford, M. Viswanathan, E. Tucker (Eds.).
19. Church A.T., Katigbak M.S. The five-factor model in the Philippines: Investigating trait structure and levels across cultures. The five-factor model across cultures 2002, 129-154. Kluwer Academic/Plenum Publishers, New York, NY. R.R. McCrae, J. Allik (Eds.).
20. Church A.T., Katigbak M.S., Miramontes L.G., del Prado A.M., Cabrera H.F. Culture and the behavioral manifestations of traits: An application of the act frequency approach. European Journal of Personality 2007, 21:389-417. 10.1002/per.631.
21. Church A.T., Katigbak M.S., Reyes J.A.S., Salanga M.G.C., Miramontes L.A., Adams N.B. Prediction and cross-situational consistency of daily behavior across cultures: Testing trait and cultural psychology perspectives. Journal of Research in Personality 2008, 42:1199-1215. 10.1016/j.jrp.2008.03.007.
22. Cole D.A., Maxwell S.E., Arvey R., Salas E. Multivariate group comparisons of variable systems: MANOVA and structural equation modeling. Psychological Bulletin 1993, 114:174-184. 10.1037/0033-2909.114.1.174.
23. Costa P.T., McCrae R.R. Revised NEO Personality Inventory (NEO-PI-R) and NEO Five-Factor Inventory (NEO-FFI) professional manual 1992, Psychological Assessment Resources, Odessa, FL.
24. Costa P.T., Terracciano A., McCrae R.R. Gender differences in personality traits across cultures: Robust and surprising findings. Journal of Personality and Social Psychology 2001, 81:322-331. 10.1037/0022-3514.81.2.322.
25. Del Pilar, G. H. (1998). L'extraversion en psychologie differentielle et l'extratension au Test De Rorschach [Extraversion in differential psychology and Rorschach extratension] (Doctoral dissertation, University of Paris X-Nanterre).
26. Ellis B.B. Extension and evaluation of the Humphreys/Hulin emic item identification hypothesis using item response theory. European perspectives in psychology 1990, Vol. 1:43-55. John Wiley, New York, NY. P.J.D. Drenth, J.A. Sergeant, R.J. Takens (Eds.).
27. Ellis B.B., Becker P., Kimmel H.D. An item response theory evaluation of an English version of the Trier Personality Inventory (TPI). Journal of Cross-Cultural Psychology 1993, 24:133-148. 10.1177/0022022193242001.
28. Ellis B.B., Mead A.D. Assessment of the measurement equivalence of a Spanish translation of the 16PF Questionnaire. Educational and Psychological Measurement 2000, 60:787-807. 10.1177/00131640021970781.
29. Embretson S.E., Reise S.P. Item response theory for psychologists 2000, Lawrence Erlbaum, Mahwah, NJ.
30. Finch W.H., French B.F. Detection of crossing differential item functioning: A comparison of four methods. Educational and Psychological Measurement 2007, 67:565-582. 10.1177/0013164406296975.
31. Finch W.H., French B.F. Using exploratory factor analysis for locating invariant referents in factor invariance studies. Journal of Modern Applied Statistical Methods 2008, 7:223-233.
32. French B.F., Finch W.H. Confirmatory factor analytic procedures for the determination of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal 2006, 13:378-402. 10.1207/s15328007sem1303_3.
33. French, B. F., & Fincha, W. H. (2008, March). When under the influence of non-invariant factor loadings, does computation method of the factor score matter? Paper presented at the American Educational Research Association, New York, NY.
34. French, B. F., & Maller, S. J. (2006, April). The influence of differential item functioning on internal consistency reliability. Paper presented at the American Educational Research Association, San Francisco, CA.
35. French B.F., Maller S.J. Iterative purification and effect size use with logistic regression for DIF detection. Educational and Psychological Measurement 2007, 67:373-393. 10.1177/0013164406294781.
36. French, B. F., Maller, S. J., & Zumbo, B. (2007, April). The influence of differential item functioning on multi-sample confirmatory factor analysis. Paper presented at the National Council on Measurement in Education conference, Chicago, IL.
37. Gelade G.A., Dobson P., Gilbert P. National differences in organizational commitment: Effect of economy, product of personality, or consequence of culture?. Journal of Cross-Cultural Psychology 2006, 37:542-556. 10.1177/0022022106290477.
38. Gellman M. The revised NEO Personality Inventory: Manual supplement for the Spanish edition 1994, Psychological Assessment Resources, Odessa, FL.
39. Hancock G.R. Structural equation modeling methods of hypothesis testing of latent variable means. Measurement and Evaluation in Counseling and Development 1997, 30:91-105.
40. Heine S.J., Buchtel E.E., Norenzayan A. What do cross-national comparisons of personality traits tell us? The case of conscientiousness. Psychological Science 2008, 19:309-313. 10.1111/j.1467-9280.2008.02085.x.
41. Heine S.J., Lehman D.R., Peng K., Greenholtz J. What's wrong with cross-cultural comparisons of subjective Likert scales? The reference-group effect. Journal of Personality and Social Psychology 2002, 82:903-918. 10.1037/0022-3514.82.6.903.
42. Hofstede G., McCrae R.R. Personality and culture revisited: Linking traits and dimensions of culture. Cross-Cultural Research 2004, 38:52-88. 10.1177/1069397103259443.
43. Huang C.D., Church A.T., Katigbak M.S. Identifying cultural differences in items and traits: Differential item functioning in the NEO Personality Inventory. Journal of Cross-Cultural Psychology 1997, 28:192-218. 10.1177/0022022197282004.
44. Johnson W., Spinath F., Krueger R.F., Angleitner A., Riemann R. Personality in Germany and Minnesota: An IRT-based comparison of MPQ self-reports. Journal of Personality 2008, 76:665-706. 10.1111/j.1467-6494.2008.00500.x.
45. Kahn J.H. Factor analysis in counseling psychology research, training, and practice: Principles, advances, and applications. The Counseling Psychologist 2006, 34:684-718. 10.1177/0011000006286347.
46. Katigbak M.S., Church A.T., Guanzon-Lapeña M.A., Carlota A.J., del Pilar G.H. Are indigenous personality dimensions culture specific? Philippine inventories and the five-factor model. Journal of Personality and Social Psychology 2002, 82:89-101. 10.1037/0022-3514.82.1.89.
47. Labouvie E., Ruetsch C. Testing for equivalence of measurement scales: Simple structure and metric invariance reconsidered. Multivariate Behavioral Research 1995, 30:63-76. 10.1207/s15327906mbr3001_4.
48. Leung K., Bond M.H. Social axioms: A model for social beliefs in multicultural perspective. Advances in experimental social psychology 2004, Vol. 36:119-197. Elsevier Academic Press, San Diego, CA. M.P. Zanna (Ed.).
49. Levine R.V., Norenzayan A. The pace of life in 31 countries. Journal of Cross-Cultural Psychology 1999, 30:178-205. 10.1177/0022022199030002003.
50. Li Z., Zumbo B.D. Impact of differential item functioning on subsequent statistical conclusions based on observed test score data. Psicológica 2009, 30:343-370.
51. Lynch R. Social acceptance reconsidered enlarged, Institute of Philippine Culture Papers No. 2. Four readings on Philippine values 1973, 1-68. Ateneo de Manila University Press, Quezon City, Philippines. 4th ed. F. Lynch, A. de Guzman (Eds.).
52. McCrae R.R. Trait psychology and culture: Exploring intercultural comparisons. Journal of Personality 2001, 69:819-846. 10.1111/1467-6494.696166.
53. McCrae R.R. NEO-PI-R data from 36 cultures: Further intercultural comparisons. The five-factor model of personality across cultures 2002, 105-125. Kluwer Academic/Plenum Publishers, New York, NY. R.R. McCrae, J. Allik (Eds.).
54. McCrae R.R. Human nature and culture: A trait perspective. Journal of Research in Personality 2004, 38:3-14. 10.1016/j.jrp.2003.09.009.
55. McCrae R.R., Allik J. The five-factor model across cultures 2002, Kluwer/Plenum, New York, NY.
56. McCrae R.R., Costa P.T., del Pilar G.Y., Rolland J.-P., Parker W.D. Cross-cultural assessment of the five-factor model: The Revised NEO Personality Inventory. Journal of Cross-Cultural Psychology 1998, 29:171-188. 10.1177/0022022198291009.
57. McCrae R.R., Terracciano A. The five-factor model and its correlates in individuals and cultures. Multilevel analyses of individuals and cultures 2008, 249-283. Erlbaum, Mahwah, NJ. F.J.R. van de Vijver, D.A. van Hemert, Y.H. Poortinga (Eds.).
58. McCrae R.R., Terracciano A. Universal features of personality traits from the observer's perspective: Data from 50 cultures. Journal of Personality and Social Psychology 2005, 88:547-561. 78 Members of the Personality Profiles of Cultures Project. 10.1037/0022-3514.88.3.547.
59. McCrae R.R., Terracciano A. Personality profiles of cultures: Aggregate personality traits. Journal of Personality and Social Psychology 2005, 89:407-425. 79 Members of the Personality Profiles of Cultures Project. 10.1037/0022-3514.89.3.407.
60. McCrae R.R., Terracciano A., De Fruyt F., De Bolle M., Gelfand M.J., Costa P.T. The validity and structure of culture-level personality scores: Data from ratings of young adolescents. Journal of Personality 2010, 78:815-838. 42 Collaborators of the Adolescent Personality Profiles of Cultures Project. 10.1111/j.1467-6494.2010.00634.x.
61. Meade A.W., Lautenschlager G.J. A comparison of item response theory and confirmatory factor analytic methodologies for establishing measurement equivalence/invariance. Organizational Research Methods 2004, 7:361-388. 10.1177/1094428104268027.
62. Mõttus R., Allik J., Realo A. An attempt to validate national mean scores of Conscientiousness: No necessarily paradoxical findings. Journal of Research in Personality 2010, 44:630-640. 10.1016/j.jrp.2010.08.005.
63. Nunnally J.C., Bernstein I.H. Psychometric theory 1994, McGraw-Hill, New York, NY.
64. Nye C.D., Roberts B.W., Saucier G., Zhou X. Testing the measurement equivalence of personality adjective items across cultures. Journal of Research in Personality 2008, 42:1524-1536. 10.1016/j.jrp.2008.07.004.
65. Oishi S., Roth D.P. The role of self-reports in culture and personality research: It is too early to give up on self-reports. Journal of Research in Personality 2009, 43:107-109. 10.1016/j.jrp.2008.11.002.
66. Olson K.R. Why do geographic differences exist in the worldwide distribution of extraversion and openness to experience? The history of human emigration as an explanation. Individual Differences Research 2007, 5:275-288.
67. Ortiz F.A., Church A.T., Vargas-Flores J., Ibanez-Reyes J., Flores-Galaz M., Iuit-Briceño J.I., Escamilla J.M. Are indigenous personality dimensions culture-specific? Mexican inventories and the five-factor model. Journal of Research in Personality 2007, 41:618-649. 10.1016/j.jrp.2006.07.002.
68. Park D.G., Lautenschlager G.J. Improving IRT item bias detection with iterative linking and ability scale purification. Applied Psychological Measurement 1990, 14:163-173. 10.1177/014662169001400205.
69. Poortinga Y.H., Van de Vijver F.J.R., Van Hemert D.A. Cross-cultural equivalence of the Big Five: A tentative interpretation of the evidence. The five-factor model of personality across cultures 2002, 281-302. Kluwer Academic/Plenum Publishers, New York, NY. R.R. McCrae, J. Allik (Eds.).
70. Raju N.S., Laffitte L.J., Byrne B.M. Measurement equivalence: A comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology 2002, 87:517-529. 10.1037/0021-9010.87.3.517.
71. Reise S.P., Smith L., Furr R.M. Invariance on the NEO PI-R Neuroticism scale. Multivariate Behavioral Research 2001, 36:83-110. 10.1207/S15327906MBR3601_04.
72. Reise S.P., Widaman K.F., Pugh R.H. Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin 1993, 114:552-566. 10.1037/0033-2909.114.3.552.
73. Saucier G. Mini-markers: A brief version of Goldberg's unipolar Big Five markers. Journal of Personality Assessment 1994, 63:506-516. 10.1207/s15327752jpa6303_8.
74. Schmitt D.P., Allik J., McCrae R.R., Benet-Martínez V. The geographic distribution of big five personality traits: Patterns and profiles of human self-description across 56 nations. Journal of Cross-Cultural Psychology 2007, 38:173-212. 10.1177/0022022106297299.
75. Stark S., Chernyshenko O.S., Drasgow F. Detecting differential item functioning with confirmatory factor analysis and item response theory: Toward a unified strategy. Journal of Applied Psychology 2006, 91:1292-1306. 10.1037/0021-9010.91.6.1292.
76. Steenkamp J.-B.E.M., Baumgartner H. Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research 1998, 25:78-107. 10.1086/209528.
77. Strelau J., Angleitner A. Cross-cultural studies on temperament: Theoretical considerations and empirical studies based on the Pavlovian Temperament Survey. Personality and Individual Differences 1994, 16:331-342. 10.1016/0191-8869(94)90170-8.
78. Taylor T.R., Boeyens J.C. The comparability of scores of Blacks and Whites on the South African Personality Questionnaire: An exploratory study. South African Journal of Psychology 1991, 21:1-11.
79. Tellegen A., Waller N.G. Exploring personality through test construction: Development of the Multidimensional Personality Questionnaire. Handbook of personality theory and testing: Personality measurement and assessment 2008, Vol. 2:261-292. Sage, London, England. G.J. Boyle, G. Matthews, D.H. Saklofske (Eds.).
80. Terracciano A., Abdel-Khalek A.M., ádám N., Adamovová L., Ahn C.-K., Ahn H.-N., McCrae R.R. National character does not reflect mean personality trait levels in 49 cultures. Science 2005, October 7, 310:96-100. 10.1126/science.1117199.
81. Vandenberg R.J., Lance C.E. A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods 2000, 3:4-70. 10.1177/109442810031002.
82. van de Vijver F.J., Leung K. Methods and data analysis for cross-cultural research 1997, Sage, Thousand Oaks, CA.
83. van Leest P.F. Bias and equivalence research in the Netherlands. European Review of Applied Psychology/Revue Européenne de Psychologie Appliquée 1997, 47:319-329.
84. Waller N.G., Thompson J.S., Wenk E. Using IRT to separate measurement bias from true group differences on homogeneous and heterogeneous scales: An illustration with the MMPI. Psychological Methods 2000, 5:125-146. 10.1037/1082-989X.5.1.125.
85. Zumbo B.D. Does item-level DIF manifest itself in scale-level analysis? Implications for translating language tests. Language Testing 2003, 20:136-147. 10.1191/0265532203lt248oa.
86. Zumbo B.D., Koh K.H. Manifestation of differences in item-level characteristics in scale-level measurement invariance tests of multi-group confirmatory factor analysis. Journal of Modern Applied Statistical Methods 2005, 4:275-282.