An evaluation of the consequences of using short measures of the Big Five personality traits

Journal of Personality and Social Psychology

Volumn 102, Issue 4, 2012, Pages 874-888

  Credé, Marcus ^a   Harms, Peter ^b   Niehorster, Sarah ^a   Gaye Valentine, Andrea ^a  

^a STATE UNIVERSITY OF NEW YORK   (United States)

^b UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

Big Five personality traits; Personality measurement; Short scales; Type 1 error; Type 2 error; Validity

Indexed keywords

ADULT; ARTICLE; COMPARATIVE STUDY; EPIDEMIOLOGY; EVALUATION; FEMALE; HUMAN; INSTRUMENTATION; MALE; MIDDLE AGED; PERSONALITY; PERSONALITY TEST; PHYSIOLOGY; PSYCHOMETRY; REPRODUCIBILITY; STANDARD;

ADULT; BIAS (EPIDEMIOLOGY); FEMALE; HUMANS; MALE; MIDDLE AGED; PERSONALITY; PERSONALITY ASSESSMENT; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS;

EID: 84864497464     PISSN: 00223514     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0027403     Document Type: Article

References (74)

1. Aronson, Z. H., Reilly, R. R., & Lynn, G. S. (2006). The impact of leader personality on new product development teamwork and performance: The moderating role of uncertainty. Journal of Engineering and Technology Management, 23, 221-247. doi:10.1016/j.jengtecman.2006 .06.003
2. Barrick, M. R., & Mount, M. K. (1991). The Big Five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1-26. doi:10.1111/j.1744-6570.1991.tb00688.x
3. Barrick, M. R., Mount, M. K., & Judge, T. A. (2001). Personality and performance at the beginning of the new millennium: What do we know and where do we go next? International Journal of Selection and Assessment, 9, 9-30. doi:10.1111/1468-2389.00160
4. Beck, E., Burnet, K. L., & Vosper, J. (2006). Birth-order effects on facets of extraversion. Personality and Individual Differences, 40, 953-959. doi:10.1016/j.paid.2005.09.012
5. Bernard, L. C., Walsh, R. P., & Mills, M. (2005). Ask once, may tell: Comparative validity of single and multiple item measurement of the Big-Five personality factors. Counseling and Clinical Psychology Journal, 2, 40-57.
6. Berry, C. M., Ones, D. S., & Sackett, P. R. (2007). Interpersonal deviance, organizational deviance, and their common correlates: A review and meta-analysis. Journal of Applied Psychology, 92, 410-424. doi: 10.1037/0021-9010.92.2.410
7. Bogg, T., & Roberts, B. W. (2004). Conscientiousness and health behaviors: A meta-analysis. Psychological Bulletin, 130, 887-919. doi: 10.1037/0033-2909.130.6.887
8. Borman, W., Penner, L., Allen, T., & Motowidlo, S. (2001). Personality predictors of citizenship performance. International Journal of Selection and Assessment, 9, 52-69. doi:10.1111/1468-2389.00163
9. Burisch, M. (1984a). Approaches to personality inventory construction: A comparison of merits. American Psychologist, 39, 214-227. doi: 10.1037/0003-066X.39.3.214
10. Burisch, M. (1984b). You don't always get what you pay for: Measuring depression with short and simple versus long and sophisticated scales. Journal of Research in Personality, 18, 81-98. doi:10.1016/00926566(84)90040-0
11. Burisch, M. (1997). Test length and validity revisited. European Journal of Personality, 11, 303-315. doi:10.1002/(SICI)1099-0984(199711)11: 4<303::AID-PER292>3.0.CO;2-#
12. Campbell, D. T. (1960). Recommendations for APA test standards regarding construct, trait, and discriminant validity. American Psychologist, 15, 546-553. doi:10.1037/h0048255
13. Chamorro-Premuzic, T., Bennett, E., & Furnham, A. (2007). The happy personality: Mediational role of trait emotional intelligence. Personality and Individual Differences, 42, 1633-1639. doi:10.1016/j.paid .2006.10.029
14. Condon, L., Ferrando, P. J., & Demestre, J. (2006). A note on the item characteristics related to acquiescent responding. Personality and Individual Differences, 40, 403-407. doi:10.1016/j.paid.2005.07.019
15. Cools, E., & Van den Broeck, H. (2007). Development and validation of the Cognitive Style Indicator. The Journal of Psychology: Interdisciplinary and Applied, 141, 359-387. doi:10.3200/JRLP.141.4.359-388
16. Costa, P. T., Jr., & McCrae, R. R. (1992). NEO-PI-R professional manual. Odessa, FL: Psychological Assessment Resources.
17. Credé, M. (2010). Random responding as a threat to the validity of effect size estimates in correlational research. Educational and Psychological Measurement, 70, 596-612. doi:10.1177/0013164410366686
18. Credé, M., Chernyshenko, O. S., Stark, S., Dalal, R. S., & Bashshur, M. (2007). Job satisfaction as mediator: An assessment of job satisfaction's position within the nomological network. Journal of Occupational and Organizational Psychology, 80, 515-538. doi:10.1348/096317906X136180
19. Cronbach, L. J. (1960). Essentials of psychological testing (2nd ed.). New York, NY: Harper & Row.
20. Donnellan, M. B., Oswald, F. L., Baird, B. M., & Lucas, R. E. (2006). The Mini-IPIP scales: Tiny-yet-effective measures of the Big Five factors of personality. Psychological Assessment, 18, 192-203. doi:10.1037/10403590.18.2.192
21. Gallen, R. T., & Berry, D. T. (1996). Detection of random-responding in MMPI-2 protocols. Assessment, 3, 171-178.
22. Gallen, R. T., & Berry, D. T. (1997). Partially random MMPI-2 protocols: When are they interpretable? Assessment, 4, 61-68.
23. Goldberg, L. R. (1999). A broad-bandwidth, public domain, personality inventory measuring the lower-level facets of several five-factor models. In I. Mervielde, I. Deary, F. De Fruyt, & F. Ostendorf (Eds.), Personality psychology in Europe (Vol. 7, pp. 7-28). Tilburg, the Netherlands: Tilburg University Press.
24. Goldberg, L. R., Johnson, J. A., Eber, H. W., Hogan, R., Ashton, M. C., Cloninger, C. R., & Gough, H. C. (2006). The International Personality Item Pool and the future of public-domain personality measures. Journal of Research in Personality, 40, 84-96. doi:10.1016/j.jrp.2005.08.007
25. Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003). A very brief measure of the Big Five personality domains. Journal of Research in Personality, 37, 504-528. doi:10.1016/S0092-6566(03)00046-1
26. Hogan, J., & Roberts, B. W. (1996). Issues and non-issues in the fidelitybandwidth trade-off. Journal of Organizational Behavior, 17, 627-637. doi:10.1002/(SICI)1099-1379(199611)17:6<627::AID-JOB2828>3.0.CO; 2-F
27. Ilies, R., Fulmer, I. S., Spitzmuller, M., & Johnson, M. D. (2009). Personality and citizenship behavior: The mediating role of job satisfaction. Journal of Applied Psychology, 94, 945-959. doi:10.1037/a0013329
28. Janes, J. (1999). Survey construction. Library Hi Tech, 17, 321-325. doi:10.1108/07378839910289376
29. John, O. P., Donahue, E. M., & Kentle, R. L. (1991). The Big Five Inventory-Versions 4a and 54. Berkeley, CA: University of California, Berkeley, Institute of Personality and Social Research.
30. John, O. P., & Soto, C. J. (2007). The importance of being valid: Reliability and the process of construct validation. In R. W. Robins, R. C. Fraley, & R. F. Krueger (Eds.), Handbook of research methods in personality psychology (pp. 461-494). New York, NY: Cambridge University Press
31. Judge, T. A., Heller, D., & Mount, M. K. (2002). Five-factor model of personality and job satisfaction: A meta-analysis. Journal of Applied Psychology, 87, 530-541. doi:10.1037/0021-9010.87.3.530
32. Kim, H. J., Shin, K. H., & Swanger, N. (2009). Burnout and engagement: A comparative analysis using the Big Five personality dimensions. International Journal of Hospitality Management, 28, 96-104. doi: 10.1016/j.ijhm.2008.06.001
33. Koch, W. R., & Dodd, B. G. (1990). Computer adaptive measurements of attitudes. Measurement and Evaluation in Counseling and Development, 23, 20-30.
34. Krosnick, J. A. (1999). Survey research. Annual Review of Psychology, 50, 537-567. doi:10.1146/annurev.psych.50.1.537
35. Kuncel, N. R., Credé, M., & Thomas, L. L. (2005). The validity of self-reported grade point averages, class rank, and test scores: A metaanalysis and review of the literature. Review of Educational Research, 75, 63-82. doi:10.3102/00346543075001063
36. Kunin, T. (1955). The construction of a new type of attitude measure. Personnel Psychology, 8, 65-77. doi:10.1111/j.1744-6570.1955 .tb01189.x
37. Loo, R., & Kells, P. (1998). A caveat on using single-item measures. Employee Assistance Quarterly, 14, 75-80. doi:10.1300/J022v14n02_06
38. Luthans, F., Avolio, B., Avey, J., & Norman, S. M. (2007). Positive psychological capital: Measurement and relationship with performance and satisfaction. Personnel Psychology, 60, 541-572. doi:10.1111/ j.1744-6570.2007.00083.x
39. McCrae, R. R., Kurtz, J. E., Yamagata, S., & Terracciano, A. (2011). Internal consistency, retest reliability, and their implications for personality scale validity. Personality and Social Psychology Review, 15, 28-50.
40. Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749. doi: 10.1037/0003-066X.50.9.741
41. Miquelon, P., & Vallerand, R. J. (2008). Goal motives, well-being, and physical health: An integrative model. Canadian Psychology/ Psychologie canadienne, 49, 241-249. doi:10.1037/a0012759
42. Mondak, J. J., Hibbing, M. V., Canache, D., Seligson, M. A., & Anderson, M. R. (2010). Personality and civic engagement: An integrative framework for the study of trait effects on political behavior. American Political Science Review, 104, 85-110. doi:10.1017/S0003055409990359
43. Moreno, R., Martinez, R. J., & Muniz, J. (2006). New guidelines for developing multiple-choice items. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 2, 65-72. doi:10.1027/1614-2241.2.2.65
44. Nagy, M. S. (2002). Using a single-item approach to measure facet job satisfaction. Journal of Occupational and Organizational Psychology, 75, 77-86. doi:10.1348/096317902167658
45. O'Connor, M. C., & Paunonen, S. V. (2007). Big Five personality predictors of post-secondary academic performance. Personality and Individual Differences, 43, 971-990. doi:10.1016/j.paid.2007.03.017
46. Paunonen, S. V. (2003). Big Five factors of personality and replicated predictions of behavior. Journal of Personality and Social Psychology, 84, 411-422. doi:10.1037/0022-3514.84.2.411
47. Paunonen, S. V., & Jackson, D. N. (1985). The validity of formal and informal personality assessment. Journal of Research in Personality, 19, 331-342. doi:10.1016/0092-6566(85)90001-7
48. Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common-method bias in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879-903. doi:10.1037/0021-9010.88.5.879
49. Rammstedt, B., & John, O. P. (2007). Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German. Journal of Research in Personality, 41, 203-212. doi:10.1016/ j.jrp.2006.02.001
50. Roberts, B. W., Bogg, T., Walton, K., Chernyshenko, O., & Stark, S. (2004). A lexical approach too identifying the lower-order structure of conscientiousness. Journal of Research in Personality, 38, 164-178. doi:10.1016/S0092-6566(03)00065-5
51. Robins, R. W., Hendin, H. M., & Trzesniewski, K. H. (2001). Measuring global self-esteem: Construct validation of a single-item measure and the Rosenberg Self-Esteem Scale. Personality and Social Psychology Bulletin, 27, 151-161. doi:10.1177/0146167201272002
52. Rosnow, R. L., & Rosenthal, R. (1974). Taming of the volunteer problem: On coping with artifacts by benign neglect. Journal of Personality and Social Psychology, 30, 188-190. doi:10.1037/h0036535
53. Russell, S. S., Spitzmueller, C., Fin, L. F., Stanton, J. M., Smith, P. C., & Ironson, G. H. (2004). Shorter can also be better: The abridged Job in General Scale. Educational and Psychological Measurement, 64, 878-893. doi:10.1177/0013164404264841
54. Salgado, J. (2002). The Big Five personality dimensions and counterproductive behaviors. International Journal of Selection and Assessment, 10, 117-125. doi:10.1111/1468-2389.00198
55. Saucier, G. (1994). Mini-markers: A brief version of Goldberg's unipolar Big-Five markers. Journal of Personality Assessment, 63, 506-516. doi:10.1207/s15327752jpa6303_8
56. Schmitt, N. (1996). The uses and abuses of coefficient alpha. Psychological Assessment, 8, 350-353. doi:10.1037/1040-3590.8.4.350
57. Schmitt, N., & Stults, D. M. (1985). Factors defined by negatively keyed items: The result of careless respondents? Applied Psychological Measurement, 9, 367-373. doi:10.1177/014662168500900405
58. Shafer, A. B. (1999). Brief bipolar markers for the five factor model of personality. Psychological Reports, 84, 1173-1179.
59. Sheldon, K. M., & Hoon, T. H. (2007). The multiple determination of well-being: Independent effects of positive traits, needs, goals, selves, social supports, and cultural context. Journal of Happiness Studies, 8, 565-592. doi:10.1007/s10902-006-9031-4
60. Smith, G. T., McCarthy, D. M., & Anderson, K. G. (2000). On the sins of short-form development. Psychological Assessment, 12, 102-111. doi: 10.1037/1040-3590.12.1.102
61. Smith, P. C., Kendall, L. M., & Hulin, C. L. (1969). The measurement of satisfaction in work and retirement. Chicago, IL: Rand McNally.
62. Spector, P. (1992). Summated rating scale construction: An introduction. Newbury Park, CA: Sage
63. Stanton, J. M., Balzer, W. K., Smith, P. C., Parra, L. F., & Ironson, G. (2001). A general measure of work stress: The Stress in General Scale. Educational and Psychological Measurement, 61, 866-888. doi: 10.1177/00131640121971455
64. Stanton, J. M., & Weiss, E. M. (2002). Online panels for social science research: An introduction to the StudyResponse Project (Tech. Rep. No. 13001). Syracuse, NY: Syracuse University, School of Information Studies.
65. Stillman, T. F., Baumeister, R. F., Vohs, K. D., Lambert, N. M., Fincham, F. D., & Brewer, L. E. (2010). Personal philosophy and personnel achievement: Belief in free will predicts better job performance. Social Psychological and Personality Science, 1, 43-50. doi:10.1177/ 1948550609351600
66. Thalmeyer, A. G., Saucier, G., & Eigenhuis, A. (2011). Comparative validity of brief and medium-length Big Five and Big Six personality questionnaires. Psychological Assessment, 23, 995-1009.
67. Vickers, R. R., Conway, T. L., & Hervig, L. K. (1990). Demonstration of replicable dimensions of health behaviors. Preventive Medicine, 19, 377-401. doi:10.1016/0091-7435(90)90037-K
68. Wanous, J. P., Reichers, A. E., & Hudy, M. J. (1997). Overall job satisfaction: How good are single item measures? Journal of Applied Psychology, 82, 247-252. doi:10.1037/0021-9010.82.2.247
69. Weng, L. (2004). Impact of the number of response categories and anchor labels on coefficient alpha and test-retest reliability. Educational and Psychological Measurement, 64, 956-972. doi:10.1177/ 0013164404268674
70. Williams, L. J., & Anderson, S. E. (1991). Job satisfaction and organizational commitment as predictors of organizational citizenship and in-role behaviors. Journal of Management, 17, 601-617. doi:10.1177/ 014920639101700305
71. Wood, D., Nye, C., & Saucier, G. (2010). Identification and measurement of a more comprehensive set of person-descriptive markers in the English lexicon. Journal of Research in Personality, 44, 258-272. doi:10.1016/j.jrp.2010.02.003
72. Woods, S. A., & Hampson, S. E. (2005). Measuring the Big Five with single items using a bipolar response scale. European Journal of Personality, 19, 373-390. doi:10.1002/per.542
73. Wu, K. D., & Clark, L. A. (2003). Relations between personality traits and self-reports of daily behavior. Journal of Research in Personality, 37, 231-256.
74. Yarkoni, T. (2010). The abbreviation of personality, or how to measure 200 personality scales with 200 items. Journal of Research in Personality, 44, 180-198. doi:10.1016/j.jrp.2010.01.002