What Do Structured Selection Interviews Really Measure? The Construct Validity of Behavior Description Interviews

Human Performance

Volumn 17, Issue 1, 2004, Pages 71-93

  Van Iddekinge, Chad H ^a   Raymark, Patrick H ^b   Eidson Jr , Carl E ^c   Attenweiler, William J ^d  

^a HUMAN RESOURCES RESEARCH ORGANIZATION   (United States)

^b CLEMSON UNIVERSITY   (United States)

^c Wilson Learning Corporation   (United States)

^d NORTHERN KENTUCKY UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 1442310771     PISSN: 08959285     EISSN: None     Source Type: Journal    
DOI: 10.1207/S15327043HUP1701_4     Document Type: Article

References (60)

1. Arthur, W., Jr., Woehr, D. J., & Maldegen, R. (2000). Convergent and discriminant validity of assessment center dimensions: A conceptual and empirical re-examination of the assessment center construct-related validity paradox. Journal of Management, 26, 813-835.
2. Barrick, M. R., Patton, G. K., & Haugland, S. N. (2000). Accuracy of interview judgments of job applicant personality traits. Personnel Psychology, 53, 925-951.
3. Baydoun, R. B., & Emperado, T. K. (1994). Validation of the PSI-CS customer service scales using retail jewelry chain sales personnel [Unpublished technical report]. Rosemont, IL: London House.
4. Baydoun, R. B., Rose, D., & Orban, J. A. (1994). Development and validation of customer service scales designed for selection in retail settings [Unpublished technical report]. Rosemont, IL; London House.
5. Bentler, P.M. (1995). EQS structural equations program manaul. Encino, CA: Multivariate Software.
6. Binning, J. F., & Barrett, G. V. (1989). Validity of personnel decisions: A conceptual analysis of the inferential and evidential bases. Journal of Applied Psychology, 74, 478-494.
7. Bobko, P., Roth, P. L., & Potosky, D. (1999). Derivation and implications of a meta-analytic matrix incorporating cognitive ability, alternative predictors, and job performance. Personnel Psychology, 52, 561-589.
8. Cable, D. M., & Judge, T. A. (1997). Interviewers' perceptions of person-organization fit and organizational selection decisions. Journal of Applied Psychology, 82, 546-561.
9. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
10. Campion, M. A., Palmer, D. K., & Campion, J. E. (1997). A review of structure in the selection interview. Personnel Psychology, 50, 655-702.
11. Campion, M. A., Pursell, E. D., & Brown, B. K. (1988). Structured interviewing: Raising the psychometric properties of the employment interview. Personnel Psychology, 41, 25-42.
12. Conway, J. M. (1996). Analysis and design of Multitrait-multirater performance appraisal studies. Journal of Management, 22, 139-162.
13. Conway, J. M. (1998). Estimation and uses of the proportion of method variance for multitrait-multimethod data. Organizational Research Methods, 1, 209-222.
14. Conway, J. M., Jako, R. A., & Goodman, D. F. (1995). A meta-analysis of interrater and internal consistency reliability of selection interviews. Journal of Applied Psychology, 80, 565-579.
15. Conway, J. M., & Peneno, G. M. (1999). Comparing structured interview question types: Construct validity and applicant reactions. Journal of Business and Psychology, 13, 485-506.
16. Cortina, J. M., Goldstein, N. B., Payne, S. C., Davison, H. K. & Gilliland, S. W. (2000). The incremental validity of interview scores over and above cognitive ability and conscientiousness scores. Personnel Psychology, 53, 325-347.
17. Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302.
18. Facteau, J. D., Facteau, C. L., Jackson, K. A., & Becton, J. B. (2000, April). Do structured interviews measure KSAs? An investigation of the construct validity of interview ratings in two organizations. Paper presented at the 15th Annual Conference of the Society for Industrial and Organizational Psychology, New Orleans, LA.
19. Fleenor, J. W. (1996). Constructs and developmental assessment centers: Further troubling empirical findings. Journal of Business and Psychology, 10, 319-335.
20. Frei, R. L., & McDaniel, M. A. (1998). Validity of customer service measures in personnel selection: A review of criterion and construct evidence. Human Performance, 11, 1-27.
21. Goldberg, L. R. (1990). An alternative "description of personality": The Big-Five factor structure. Journal of Personality and Social Psychology, 59, 1216-1229.
22. Goldberg, L. R. (1992). The development of markers for the Big Five factor structure. Psychological Assessment, 4, 26-42.
23. Guion, R. M. (1998). Assessment, measurement, and prediction for personnel decisions. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
24. Harris, M. M. (1999). What is being measured? In R. W. Eder & M. M. Harris (Eds.), The employment interview handbook (pp. 105-123). Thousand Oaks, CA: Sage.
25. Hough, L. M. (2001). I/Owes it advances to personality. In R. T. Hogan & B. Roberts (Eds.), Personality psychology in the workplace (pp. 19-44). Washington, DC: American Psychological Association.
26. Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparametized model misspecification. Psychological Methods, 3, 424-453.
27. Huffcutt, A. I., & Arthur, W., Jr. (1994). Hunter and Hunter (1984) revisited: Interview validity for entry-level jobs. Journal of Applied Psychology, 79, 184-190.
28. Huffcutt, A. I., Conway, J., Roth, P. L., & Stone, N. (2001). Identification and meta-analysis of constructs measured in employment interviews. Journal of Applied Psychology, 86, 897-913.
29. Huffcutt, A. I., & Roth, P. L. (1998). Racial group differences in employment interview evaluations. Journal of Applied Psychology, 83, 179-189.
30. Huffcutt, A. I., Roth, P. L., & McDaniel, M. A. (1996). A meta-analytic investigation of cognitive ability in employment interview evaluations: Moderating characteristics and implications for incremental validity. Journal of Applied Psychology, 81, 459-473.
31. Huffcutt, A. I., Weekley, J., Wiesner, W. H., DeGroot, T., & Jones, C. (2001). Comparison of situational and behavior description interview questions for higher-level positions. Personnel Psychology, 54, 619-644.
32. Hunter, J. E., & Hirsch, H. R. (1987). Application of meta-analysis. In C. L. Cooper & I. T. Robertson (Eds.), International review of industrial and organizational psychology (pp. 321-357). Chichester, UK: Wiley.
33. James, L. R. (1980). The unmeasured variables problem in path analysis. Journal of Applied Psychology, 65, 415-421.
34. Janz, J. T. (1982). Initial comparisons of patterned behavior description interviews versus unstructured interviews. Journal of Applied Psychology, 67, 577-580.
35. Kiker, D. S., & Motowidlo, S. J. (1998). Effects of rating strategy on the interdimensional variance, reliability, and validity of interview ratings. Journal of Applied Psychology, 83, 763-768.
36. Klimoski, R., & Brickner, M. (1987). Why do assessment centers work? The puzzle of assessment center validity. Personnel Psychology, 40, 243-259.
37. Lance, C. E., Noble, C. L., & Scullen, S. E. (2002). A critique of the correlate trait-correlated method and correlated uniqueness models formultitrait-multimethod data. Psychological Methods, 7, 228-244.
38. Latham, G. P., Saari, S. M., Pursell, E. D., & Campion, M. A. (1980). The situational interview. Journal of Applied Psychology, 65, 422-427.
39. Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28, 563-575.
40. Lievens, F., & Conway, J. M. (2001). Dimension and exercise variance in assessment center scores: A large-scale evaluation of multitrait-multimethod studies. Journal of Applied Psychology, 8, 1202-1222.
41. London House. (1995). Personnel selection inventory: PSI-CS with math. Rosemont, IL: Author.
42. McDaniel, M. A., Whetzel, D. L., Schmidt, F. L., & Maurer, S. (1994). The validity of employment interviews: A comprehensive review and meta-analysis. Journal of Applied Psychology, 79, 599-616.
43. Motowidlo, S. J., Carter, G. W., Dunnette, M. D., Tippins, N. T., Werner, S., Burnett, J. R., et al. (1992). Studies of the structured behavioral interview. Journal of Applied Psychology, 77, 571-587.
44. Mount, M. K., & Barrick, M. R. (1995). The personal characteristics inventory manual. Unpublished manuscript, University of Iowa.
45. Mount, M. K., Barrick, M. R., & Stewart, G. L. (1998). Five-factor model of personality and performance in jobs involving interpersonal interactions. Human Performance, 11, 145-165.
46. Ones, D.S., Schmidt, F. L., & Viswesvaran, C. (1994, April). Do broader personality variables predict job performance with higher validity? In R. Page (Chair), Personality and job performance. Symposium at the 9th Annual Conference of the Society for Industrial and Organizational Psychology, St. Louis, MO.
47. Osborn, S. M., Field, H. S., & Veres, J. G. (1998). Introversion-extraversion, self-monitoring, and applicant performance in a situational panel interview: A field study. Journal of Business and Psychology, 13, 143-156.
48. Posthuma, R. A., Morgeson, F. P., & Campion, M. A. (2002). Beyond employment interview validity: A comprehensive narrative review of recent research and trends over time. Personnel Psychology, 55, 1-81.
49. Roth, P. L., Van Iddekinge C. H., Huffcutt, A. I., Eidson, C. E., Jr., & Bobko, P. (2002). Corrections for range restriction in structured interview ethnic group differences: The values may be larger than researchers thought. Journal of Applied Psychology, 87, 369-376.
50. Sackett, P. R., & Dreher, G. F. (1982), Constructs and assessment center dimensions: Some troubling empirical findings. Journal of Applied Psychology, 67, 410.
51. Sackett, P. R., & Harris, M. M. (1988). A further examination of the constructs underlying assessment center ratings. Journal of Business and Psychology, 3, 214-229.
52. Sackett, P. R., & Wanek, J. E. (1996). New developments in the use of measures of honesty, integrity, conscientiousness, dependability, trustworthiness, and reliability for personnel selection. Personnel Psychology, 49, 787-829.
53. Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel selection: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262-274.
54. Schmidt, F. L., & Rader, M. (1999). Exploring the boundary conditions for interview validity: Meta-analytic findings for a new interview type. Personnel Psychology, 52, 445-464.
55. Schmitt, N., & Stults, D. M. (1986). Methodology review: Analysis of Multitrait-multimethod matrices. Applied Psychological Measurement, 10, 1-22.
56. Schneider, J. R., & Schmitt, N. (1992). An exercise design approach to understanding assessment center dimension and exercise constructs. Journal of Applied Psychology, 77, 32-41.
57. Sue-Chan, C., Latham, G. P., & Evans, M. G. (1995). The construct validity of the situational interview and patterned behavior description interviews: Cognitive ability, tacit knowledge, and self-efficacy as correlates. Paper presented at the Annual Meeting of the Canadian Psychological Association, Charlottetown, Prince Edward Island.
58. Widaman, K. F. (1985). Hierarchically nested covariance structure models for multitrait-multimethod data. Applied Psychological Measurement, 9, 1-26.
59. Wilk, S. L., & Cappelli, P. (2003). Understanding the determinants of employer use of selection methods. Personnel Psychology, 56, 103-124.
60. Woehr, D. J., & Arthur, W., Jr. (2003). The construct-related validity of assessment center ratings: A review and meta-analysis of the role of methodological factors. Journal of Management, 29, 231-258.