Assessing personality with a structured employment interview: Construct-related validity and susceptibility to response inflation

Journal of Applied Psychology

Volumn 90, Issue 3, 2005, Pages 536-552

  Van Iddekinge, Chad H ^a   Raymark, Patrick H ^b   Roth, Philip L ^b  

^a HUMAN RESOURCES RESEARCH ORGANIZATION   (United States)

^b CLEMSON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; EPIDEMIOLOGY; FEMALE; HUMAN; JOB FINDING; MALE; PERSONALITY TEST; PERSONNEL MANAGEMENT; PSYCHOLOGIC TEST; PSYCHOMETRY; RECUMBENCY; REPRODUCIBILITY; STATISTICS;

ADULT; BIAS (EPIDEMIOLOGY); DECEPTION; FEMALE; HUMANS; INTERVIEW, PSYCHOLOGICAL; JOB APPLICATION; MALE; PERSONALITY ASSESSMENT; PERSONALITY INVENTORY; PERSONNEL SELECTION; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS;

EID: 20444463603     PISSN: 00219010     EISSN: None     Source Type: Journal    
DOI: 10.1037/0021-9010.90.3.536     Document Type: Article

References (120)

1. Bargh, J. A. (1984). Automatic and conscious processing of social information. In R. Wyer & T. Srull (Eds.), Handbook of social cognition (Vol. 3, pp. 1-43). Mahwah, NJ: Erlbaum.
2. Bargh, J. A. (1994). The four horseman of automaticity: Awareness, intention, efficiency, and control in social cognition. In R. Wyer & T. Srull (Eds.), Handbook of social cognition (Vol. 1, 2nd ed., pp. 1-40). Mahwah, NJ: Erlbaum.
3. Bargh, J. A., & Thein, R. D. (1985). Individual construct accessibility, person memory, and the recall-judgment link: The case of information overload. Journal of Personality and Social Psychology, 49, 1129-1146.
4. Barrick, M. R., & Mount, M. K. (1996). Effects of impression management and self-deception on the predictive validity of personality constructs. Journal of Applied Psychology, 81, 261-272.
5. Barrick, M. R., Mount, M. K., & Judge, T. A. (2001). Personality and performance at the beginning of the new millennium: What do we know and where do we go next? International Journal of Selection and Assessment, 9, 9-30.
6. Barrick, M. R., Patton, G. K., & Haugland, S. N. (2000). Accuracy of interview judgments of job applicant personality traits. Personnel Psychology, 53, 925-951.
7. Binning, J. F., LeBreton, J. M., & Adorno, A. J. (1999). Assessing personality. In R. W. Eder & M. M. Harris (Eds.), The employment interview handbook (pp. 105-123). Thousand Oaks, CA: Sage.
8. Blackman, M. C. (2002). Personality judgment and the utility of the unstructured employment interview. Basic and Applied Social Psychology, 24, 241-250.
9. Blackman, M. C., & Funder, D. C. (1998). The effect of information on consensus and accuracy in personality judgment. Journal of Experimental Social Psychology, 34, 164-181.
10. Blackman, M. C., & Funder, D. C. (2002). Effective interview practices for accurately assessing counterproductive traits. International Journal of Selection and Assessment, 10, 109-116.
11. Borkenau, P., & Liebler, A. (1992). Trait inferences: Sources of validity at zero acquaintance. Journal of Personality and Social Psychology, 62, 645-657.
12. Borman, W. C., Hanson, M. A., & Hedge, J. W. (1997). Personnel selection. Annual Review of Psychology, 48, 299-337.
13. Bozeman, D. P., & Kacmar, K. M. (1997). A cybernetic model of impression management processes in organizations. Organizational Behavior and Human Decision Processes, 69, 9-30.
14. Brown, D. J., Diefendorff, J. M., Kamin, A. M., & Lord, R. G. (1999, April). Predicting organizational citizenship with the big five: The source matters. Paper presented at the 14th Annual Conference of the Society of Industrial and Organizational Psychology, Atlanta, GA.
15. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136-142). Newbury Park, CA: Sage.
16. Burnkrant, S. R. (2001, April). Faking personality profiles: Jobdesirability or social desirability. Paper presented at the 16th Annual Conference of the Society for Industrial and Organizational Psychology, San Diego, CA.
17. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
18. Cascio, W. F., & Phillips, N. F. (1979). Performance testing: A rose among thorns. Personnel Psychology, 32, 751-766.
19. Cellar, D. F., Miller, M. L., Doverspike, D. D., & Klawsky, J. D. (1996). Comparison of factor structures and criterion-related validity coefficients for two measures of personality based of the five factor model. Journal of Applied Psychology, 81, 694-704.
20. Cohen, J., & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum.
21. Colquitt, J. A., LePine, J. A., & Noe, R. A. (2000). Toward an integrative theory of training motivation: A meta-analytic path analysis of 20 years of research. Journal of Applied Psychology, 85, 678-707.
22. Colvin, C. R., & Funder, D. C. (1991). Predicting personality and behavior: A boundary on the acquaintanceship effect. Journal of Personality and Social Psychology, 60, 884-894.
23. Connolly, J. J., & Viswesvaran, C. (1998, April). The convergent validity between self- and observer ratings of personality. Paper presented at the 13th Annual Conference of the Society for Industrial and Organizational Psychology, Dallas, TX.
24. Conway, J. M., Jako, R. A., & Goodman, D. F. (1995). A meta-analysis of interrater and internal consistency reliability of selection interviews. Journal of Applied Psychology, 80, 565-579.
25. Conway, J. M., & Peneno, G. M. (1999). Comparing structured interview question types: Construct validity and applicant reactions. Journal of Business and Psychology, 13, 485-506.
26. Cook, K. W., Vance, C. A., & Spector, P. E. (2000). The relation of candidate personality with selection-interview outcomes. Journal of Applied Social Psychology, 30, 867-885.
27. Cortina, J. M., Goldstein, N. B., Payne, H. K., Davison, & Gilliland, S. W. (2000). The incremental validity of interview scores over and above cognitive ability and conscientiousness scores. Personnel Psychology, 53, 325-347.
28. Costa, P. T., & McCrae, R. R. (1992). Professional manual for the Revised NEO Personality Inventory (NEO PI-R) and the NEO Five Factor Inventory (NEO-FFF). Odessa, FL: Psychological Assessment Resources.
29. Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302.
30. DePaulo, B. M., Lindsay, J. L., Malone, B. E., Muhlenbruck, L., Charlton, K., & Cooper, H. (2003). Cues to deception. Psychological Bulletin, 129, 74-118.
31. DePaulo, B. M., Stone, J. I., & Lassiter, G. D. (1985). Deceiving and detecting deceit. In B. R. Schlenker (Ed.), The self and social life (pp. 323-370). New York: McGraw-Hill.
32. DeShon, R. P., & Alexander, R. A. (1996). Goal setting effects on implicit and explicit learning of complex tasks. Organizational Behavior and Human Decision Processes, 65, 18-36.
33. Douglas, E. F., McDaniel, M. A., & Snell, A. F. (1996, August). The validity of non-cognitive measures decays when applicants fake. Paper presented at the 11th Annual Conference of the Academy of Management, Cincinnati, OH.
34. DuBois, C. L. Z., Sackett, P. R., Zedeck, S., & Fogli, L. (1993). Further exploration of typical and maximum performance criteria: Definitional issues, prediction, and White-Black differences. Journal of Applied Psychology, 78, 205-211.
35. Ellingson, J. E., Smith, D. B., & Sackett, P. R. (2001). Investigating the influence of social desirability on personality factor structure. Journal of Applied Psychology, 86, 122-133.
36. Ellis, A. P. J., West, B. J., Ryan, A. M., & DeShon, R. P. (2002). The use of impression management tactics in structured interviews: A function of question type? Journal of Applied Psychology, 87, 1200-1208.
37. Frei, R. L., & McDaniel, M. A. (1998). Validity of customer service measures in personnel selection: A review of criterion and construct evidence. Human Performance, 11, 1-27.
38. Funder, D. C. (1995). On the accuracy of personality judgment: A realistic approach. Psychological Review, 102, 652-670.
39. Funder, D. C. (1999). Personality judgment: A realistic approach to person perception. San Diego, CA: Academic Press.
40. Funder, D. C. (2001). The personality puzzle (2nd ed.). New York: Norton.
41. Funder, D. C., & Colvin, C. R. (1988). Friends and strangers: Acquaintanceship, agreement, and the accuracy of personality judgment. Journal of Personality and Social Psychology, 55, 149-158.
42. Funder, D. C., & Dobroth, K. M. (1987). Differences between traits: Properties associated with inter-judge agreement. Journal of Personality and Social Psychology, 52, 409-418.
43. Funder, D. C., & Sneed, C. D. (1993). Behavioral manifestations of personality: An ecological approach to judgmental accuracy. Journal of Personality and Social Psychology, 64, 479-490.
44. Gilbert, D. T., & Osborne, R. E. (1989). Thinking backward: Some curable and incurable consequences of cognitive busyness. Journal of Personality and Social Psychology, 57, 940-946.
45. Goffin, R. D., Rothstein, M. G., & Johnston, N. G. (1996). Personality testing and the assessment center: Incremental validity in managerial selection. Journal of Applied Psychology, 81, 746-756.
46. Goldberg, L. R. (1990). An alternative "description of personality": The Big-Five factor structure. Journal of Personality and Social Psychology, 59, 1216-1229.
47. Goldberg, L. R. (1993). The structure of phenotypic personality traits. American Psychologist, 48, 26-34.
48. Griffith, R. L., Chmielowski, T. S., Snell, A. F., Frei, R. L., & McDaniel, M. A. (2000, April). Does faking matter? An examination of rank order changes in applicant data. In D. B. Schmidt (Chair), Assessing the prevalence and impact of applicant faking. Symposium conducted at the 15th Annual Conference of the Society for Industrial and Organizational Psychology, New Orleans, LA.
49. Hamill, D., & Bartle, S. (1998, April). Applicant perceptions of selection procedures and future job seeking behaviors. Paper presented at the 13th Annual Conference of the Society for Industrial and Organizational Psychology, Dallas, TX.
50. Hogan, R., Hogan, J., & Roberts, B. W. (1996). Personality measurement and employment decisions. American Psychologist, 51, 469-477.
51. Hough, L. M. (1998). Effects of intentional distortion in personality measurement and evaluation of suggested palliatives. Human Performance, 11, 209-244.
52. Hough, L. M., Eaton, N. K., Dunnette, M. D., Kamp, J. D., & McCloy, R. A. (1990). Criterion-related validities of personality constructs and the effect of response distortion on those validities. Journal of Applied Psychology, 75, 581-595.
53. Hough, L. M., & Furnham, A. (2003). Importance and use of personality variables in work settings. In I. B. Weiner (Ed.-in-Chief) & W. Borman, D. Ilgen, & R. Klimoski (Vol. Eds.), Handbook of psychology: Vol. 12. Industrial and organizational psychology (pp. 131-169). New York: Wiley.
54. Hough, L. M., & Ones, D. S. (2001). The structure, measurement, validity, and use of personality variables in industrial, work, and organizational psychology. In N. R. Anderson, D. S. Ones, H. K. Sinangil, & C. Viswesvaran (Eds.), Handbook of work psychology (pp. 233-377). London and New York: Sage.
55. Hough, L. M., Oswald, F. L., & Ployhart, R. E. (2001). Determinants, detection, and amelioration of adverse impact in personnel selection procedures: Issues, evidence, and lessons learned. International Journal of Selection and Assessment, 9, 152-194.
56. Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparametized model misspecification. Psychological Methods, 3, 424-453.
57. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equations Modeling, 6, 1-55.
58. Huffcutt, A. I., Conway, J. M., Roth, P. L., & Stone, N. J. (2001). Identification and meta-analytic assessment of psychological constructs measured in employment interviews. Journal of Applied Psychology, 86, 897-913.
59. Huffcutt, A. I., Weekley, J., Wiesner, W. H., DeGroot, T., & Jones, C. (2001). Comparison of situational and behavior description interview questions for higher-level positions. Personnel Psychology, 54, 619-644.
60. Jackson, D. N., Peacock, A. C., & Holden, R. R. (1982). Professional interviewers' trait inferential structures for diverse occupational groups. Organizational Behavior and Human Performance, 29, 1-20.
61. Jackson, D. N., Peacock, A. C., & Smith, J. P. (1980). Impressions of personality in the employment interview. Journal of Personality and Social Psychology, 39, 294-307.
62. Jöreskog, K. G., & Sorbom, D. (1996). LISREL 8: User's reference guide. Chicago: Scientific Software International.
63. Judge, T. A., Bono, J. E., Remus, I., & Gerhardt, M. W. (2002). Personality and leadership: A qualitative and quantitative review. Journal of Applied Psychology, 87, 765-780.
64. Judge, T. A., Martocchio, J. J., & Thoresen, C. J. (1997). Five factor model of personality and employee absence. Journal of Applied Psychology, 82, 745-755.
65. Kluger, A. N., & Collela, A. (1993). Beyond the mean bias: The effect of warning against faking on biodata item variances. Personnel Psychology, 46, 763-780.
66. Kristof, A. L. (2000). Perceived applicant fit: Distinguishing between recruiters' perceptions of person-job and person-organization fit. Personnel Psychology, 53, 643-671.
67. Kristof-Brown, A., Barrick, M. R., & Franke, M. (2002). Influences and outcomes of candidate impression management use in job interviews. Journal of Management, 28, 27-46.
68. Landy, F. J., Shankster, L. J., & Kohler, S. S. (1994). Personnel selection and placement. Annual Review of Psychology, 45, 261-296.
69. Levashina, J., & Campion, M. A. (2003, August). Faking in the employment interview. Paper presented at the 18th Annual Conference of the Academy of Management, Seattle, WA.
70. Lievens, F., & Conway, J. M. (2001). Dimension and exercise variance in assessment center scores: A large-scale evaluation of multitrait-multimethod studies. Journal of Applied Psychology, 8, 1202-1222.
71. Mann, S., Vrij, A., & Bull, R. (2004). Detecting true lies: Police officers' ability to detect suspects' lies. Journal of Applied Psychology, 89, 137-149.
72. McCrae, R. R., Zonderman, A. B., Costa, P. T., Jr., & Bond, M. H. (1996). Evaluating the replicability of factors in the Revised NEO Personality Inventory: Confirmatory factor analysis versus Procrustes rotation. Journal of Personality and Social Psychology, 70, 552-566.
73. McFarland, L. A., & Ryan, A. M. (2000). Variance in faking across noncognitive measures. Journal of Applied Psychology, 85, 812-821.
74. McFarland, L. A., Ryan, A. M., & Kriska, S. D. (2003). Impression management use and effectiveness across assessment methods. Journal of Management, 29, 641-661.
75. McGraw, K. O., & Wong, S. P. (1996). Forming inferences about some intraclass correlations coefficients. Psychological Methods, 1, 30-46.
76. McHenry, J. J., Hough, L. M., Toquam, J. T., Hanson, M. A., & Ashworth, S. (1990). Project A validity results: The relationship between predictor and criterion domains. Personnel Psychology, 43, 335-354.
77. McIntire, S. A., & Miller, L. A. (2000). Foundations of psychological testing. Boston: McGraw-Hill.
78. Miller, C. E., & Tristan, E. (2002, April). Expanding the definition of faking beyond social desirability: The case for job desirability. Paper presented at the 17th Annual Conference of the Society for Industrial and Organizational Psychology, Toronto, ON.
79. Motowidlo, S. J. (1999). Asking about past behavior versus hypothetical behavior. In R. W. Eder & M. M. Harris (Eds.), The employment interview handbook (pp. 179-190). Thousand Oaks, CA: Sage.
80. Mount, M. K., Barrick, M. R., & Stewart, G. L. (1998). Five-factor model of personality and performance in jobs involving interpersonal interactions. Human Performance, 11, 145-165.
81. Mount, M. K., Barrick, M. R., & Strauss, J. P. (1994). Validity of observer ratings of the big five personality factors. Journal of Applied Psychology, 79, 272-280.
82. Mueller-Hanson, R., Heggestad, E. D., & Thornton, G. C., III. (2003). Faking and selection: Considering the use of personality from select-in and select-out perspectives. Journal of Applied Psychology, 88, 348-355.
83. Murphy, K. R., & Davidshofer, C. O. (1998). Psychological testing: Principles and applications (4th ed.). Upper Saddle River, NJ: Prentice Hall.
84. Nilsen, D. (1995). Investigation of the relationship between personality and leadership performance. Unpublished doctoral dissertation, University of Minnesota.
85. Ones, D. S., & Viswesvaran, C. (1996). Bandwidth-fidelity dilemma in personality measurement for personnel selection. Journal of Organizational Behavior, 17, 609-626.
86. Ones, D. S., & Viswesvaran, C. (1998). The effects of social desirability and faking on personality and integrity assessment for personnel selection. Human Performance, 11, 245-269.
87. Ones, D. S., Viswesvaran, C., & Schmidt, F. L. (1993). Comprehensive meta-analysis of integrity test validities: Findings and implications for personnel selection and theories of job performance [Monograph]. Journal of Applied Psychology, 78, 679-703.
88. Paulhus, D. L. (1991). Measurement and control of response bias. In J. P. Robinson, P. R. Shaver, & L. S. Wrightsman (Eds.), Measurement of personality and social psychological attitudes (pp. 17-59). San Diego: Academic Press.
89. Paunonen, S. V., & Jackson, D. N. (1987). Accuracy of interviewers and students in identifying the personality characteristics of personnel managers and computer programmers. Journal of Vocational Behavior, 31, 26-36.
90. Paunonen, S. V., Jackson, D. N., & Oberman, S. M. (1987). Personnel selection decisions: Effects of applicant personality and letter of reference. Organizational Behavior and Human Decision Processes, 40, 96-114.
91. Paunonen, S. V., Rothstein, M. G., & Jackson, D. N. (1999). Narrow reasoning about the use of broad personality measures for personnel selection. Journal of Organizational Behavior, 20, 389-405.
92. Perry, J. C. (1992). Problems and considerations in the valid assessment of personality disorders. American Journal of Psychiatry, 149, 1645-1653.
93. Pontari, B. A., & Schlenker, B. R. (2000). The influence of cognitive load on self-presentation: Can cognitive busyness help as well as harm social performance. Journal of Personality and Social Psychology, 78, 1092-1108.
94. Robie, C., Zickar, M. J., & Schmit, M. J. (2001). Measurement equivalence between applicant and incumbent groups: An IRT analysis of personality scales. Human Performance, 14, 187-207.
95. Rosse, J. G., Stecher, M. D., Miller, J. L., & Levin, R. A. (1998). The impact of response distortion on preemployment personality testing and hiring decisions. Journal of Applied Psychology, 83, 634-644.
96. Rothstein, M., & Jackson, D. N. (1980). Decision making in the employment interview: An experimental approach. Journal of Applied Psychology, 65, 271-283.
97. Schmit, M. J., & Ryan, A. M. (1993). The big five in personnel selection: Factor structure in applicant and nonapplicant populations. Journal of Applied Psychology, 78, 966-974.
98. Schneider, R. J., Hough, L. A., & Dunnette, M. D. (1996). Broadsided by broad traits: How to sink science in five dimensions or less. Journal of Organizational Behavior, 17, 639-655.
99. Shilobod, T. L., & Raymark, P. H. (2003, August). Individual differences in ability to fake on personality measures. Paper presented at the 18th Annual Conference of the Academy of Management, Seattle, WA.
100. Shriffin, R. M., & Schneider, W. (1977). Controlled and automatic information processing: Perceptual learning, automatic attending, and a general theory. Psychological Review, 84, 127-190.
101. Smith, D. B., & Ellingson, J. E. (2002). Substance versus style: A new look at social desirability in motivating contexts. Journal of Applied Psychology, 87, 211-219.
102. Smith, D. B., Hanges, P. J., & Dickson, M. W. (2001). Personnel selection and the five-factor model: Reexamining the effects of applicant's frame of reference. Journal of Applied Psychology, 86, 304-315.
103. Smith, M. A., Moriatry, K. O., Lutrick, E. C., & Canger, J. M. (2001, April). Exploratory factor analysis of NEO PI-R for job applicants: Evidence against the Big Five. Paper presented at the 16th Annual Convention of the Society for Industrial and Organizational Psychology, San Diego, CA.
104. Smither, J. W., Reilly, R. R., Millsap, R. E., Pearlman, K., & Stoffey, R. W. (1993). Applicant reactions to selection procedures. Personnel Psychology, 46, 49-76.
105. Stark, S., Chernyshenko, O. S., Chan, K.-Y., Lee, W. C., & Drasgow, F. (2001). Effects of the testing situation on item responding: Cause for concern. Journal of Applied Psychology, 86, 943-953.
106. Steiner, D. D., & Gilliland, S. W. (1996). Fairness reactions to personnel selection techniques in France and the United States. Journal of Applied Psychology, 81, 134-141.
107. Stevens, C. K., & Kristof, A. L. (1995). Making the right impression: A field study of applicant impression management during job interviews. Journal of Applied Psychology, 80, 587-606.
108. Trull, T. J., & Widiger, T. A. (1997). Structured interview for the five-factor model of personality (SIFFM): Professional manual. Odessa, FL: Psychological Assessment Resources.
109. Trull, T. J., Widiger, T. A., & Burr, R. (2001). A structured interview for the assessment of the five-factor model of personality: Facet-level relations to the Axis II personality disorders. Journal of Personality, 69, 175-198.
110. Trull, T. J., Widiger, T. A., Useda, J. D., Holcomb, J., Doan, B., Axelrod, S. R., et al. (1998). A structured interview for the assessment of the five-factor model of personality. Psychological Assessment, 10, 229-240.
111. Tupes, E. C., & Christal, R. E. (1992). Recurrent personality factors based on trait ratings. Journal of Personality, 60, 225-251.
112. Van Iddekinge, C. H., Raymark, P. H., Eidson, C. E., Jr., & Attenweiler, W. (2004). What do structured interviews really measure? The construct validity of behavior description interviews. Human Performance, 17, 71-93.
113. Van Iddekinge, C. H., Raymark, P. H., Eidson, C. E., Jr., & Putka, D. P. (2003, April). Applicant-incumbent differences on personality, integrity, and customer service measures. Paper presented at the 18th Annual Conference of the Society for Industrial and Organizational Psychology, Orlando, FL.
114. Vrij, A., Edward, K., Roberts, K. P., & Bull, R. (2000). Detecting deceit via analysis of verbal and nonverbal behavior. Journal of Nonverbal Behavior, 24, 239-263.
115. Vrij, A., Semin, G. R., & Bull, R. (1996). Insight into behavior displayed during deception. Human Communication Research, 22, 544-562.
116. Watson, D. (1989). Strangers' ratings of the five robust personality factors: Evidence of a surprising convergence with self-report. Journal of Personality and Social Psychology, 57, 120-128.
117. Webster, E. C. (1982). The employment interview: A social judgment process. Schomberg, Canada: S. I. P.
118. Widiger, T. A., & Sanderson, C. J. (1995). Assessing personality disorders. In J. N. Butcher (Ed.), Clinical personality assessment: Practical approaches (pp. 380-394). New York: Oxford University Press.
119. Woehr, D. J., & Arthur, W., Jr. (2003). The construct-related validity of assessment center ratings: A review and meta-analysis of the role of methodological factors. Journal of Management, 29, 231-258.
120. Zimmerman, M. (1994). Diagnosing personality disorders: A review of issues and research methods. Archives of General Psychiatry, 51, 225-245.