The impact of job complexity and study design on situational and behavior description interview validity

International Journal of Selection and Assessment

Volumn 12, Issue 3, 2004, Pages 262-273

  Huffcutt, Allen I ^a   Conway, James M ^b   Roth, Philip L ^c   Klehe, Ute Christine ^d  

^a BRADLEY UNIVERSITY   (United States)

^b CENTRAL CONNECTICUT STATE UNIVERSITY   (United States)

^c CLEMSON UNIVERSITY   (United States)

^d UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 4744349409     PISSN: 0965075X     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.0965-075X.2004.280_1.x     Document Type: Review

References (78)

1. Barrett, G.V., Phillips, J.S. and Alexander, R.A. (1981) Concurrent and predictive validity designs: A critical reanalysis. Journal of Applied Psychology, 66, 1-6.
2. Bemis, S.E. (1968) Occupational validity of the General Aptitude Test Battery. Journal of Applied Psychology, 52, 240-244.
3. Borman, W.C. (1991) Job behavior, performance, and effectiveness. In M.D. Dunnette and L.M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd Edn., Vol. 2, pp. 271-326). Palo Alto, CA: Consulting Psychologists Press.
4. Bosshardt, M.J. (1992) Situational interviews versus behavior description interviews: A comparative validity study. Unpublished doctoral dissertation, University of Minnesota.
5. Burke, M.J. and Frederick, J.T. (1984) Two modified procedures for estimating standard deviations in utility analyses. Journal of Applied Psychology, 69, 482-489.
6. Campion, M.A., Campion, J.E. and Hudson, J.P., Jr. (1994) Structured interviewing: A note on incremental validity and alternative question types. Journal of Applied Psychology, 79, 998-1002.
7. Campion, M.A., Palmer, D.K. and Campion, J.E. (1997) A review of structure in the selection interview. Personnel Psychology, 50, 655-702.
8. Campion, M., Pursell, E. and Brown, B. (1988) Structured interviewing: Raising the psychometric properties of the employment interview. Personnel Psychology, 41, 25-42.
9. Cortina, J.M., Goldstein, N.B., Payne, S.C., Davison, H.K. and Gilliland, S.W. (2000) The incremental validity of interview scores over and above cognitive ability and conscientiousness scores. Personnel Psychology, 53, 325-351.
10. Davis, R. (1986) Personal communication.
11. Delery, J.E., Wright, P.M., McArthur, K. and Anderson, D.C. (1994) Cognitive ability tests and the situational interview: A test of incremental ability. International Journal of Selection and Assessment, 2, 53-58.
12. Flint, D. (1995) A situational interview for the telecommunications industry. Paper presented at the annual meeting of the Canadian Psychological Association, Charlottetown, PEI.
13. Ghiselli, E.E. (1966) The validity of a personnel interview. Personnel Psychology, 19, 389-394.
14. Gibb, J. and Taylor, P.J. (in-press) Past experience versus situational employment interview questions in a New Zealand social service agency. Asia-Pacific Journal of Human Resources.
15. Green, P.C., Alter, P. and Carr, A.F. (1993) Development of standard anchors for scoring generic past-behavior questions in structured interviews. International Journal of Selection and Assessment, 1(4), 203-212.
16. Grove, D.A. (1981) A behavioral consistency approach to decision making in employment selection. Personnel Psychology, 34, 55-64.
17. Hanson, M., Houston, J., Paullin, C. and Dohm (1992) Unfitted report. Minneapolis: Personnel Decisions Research Institutes.
18. Harel, G., Arditi-Vogel, A. and Janz, T. (n.d.) Comparing the validity and utility of interview versus assessment center ratings. Unpublished manuscript. [Under review at Managerial Psychology]
19. Harris, M.M. (1989) Reconsidering the employment interview: A review of recent literature and suggestions for future research. Personnel Psychology, 42, 691-726.
20. Hays, E.J. (1990) Relationship of a situational interview to the job performance of convenience store clerks. Unpublished master's thesis, University of North Texas, Denton, TX.
21. Hoffman, C.C. and Holden, L.M. (1993) Dissecting the interview: An application of generalizability analysis. Paper presented at the 8th Annual Meeting of the Society for Industrial and Organizational Psychology. San Francisco, CA.
22. Hough, L.M. (1998) Personality at work: Issues and evidence. In M. Hakel (Ed.), Beyond multiple choice: Evaluating alternatives to traditional testing for selection. Hillsdale, NJ: Erlbaum Assoc. Inc.
23. Huffcutt, A. and Arthur, W., Jr. (1994) Hunter and Hunter (1984) revisited: Interview validity for entry-level jobs. Journal of Applied Psychology, 79, 184-190.
24. Huffcutt, A.I., Arthur, W., Jr. and Bennett, W. (1993) Conducting meta-analysis using the Proc Means procedure in SAS. Educational and Psychological Measurement, 53, 119-131.
25. Huffcutt, A., Roth, P. and McDaniel, M. (1996) A meta-analytic investigation of cognitive ability in employment interview evaluations: Moderating characteristics and implications for incremental validity. Journal of Applied Psychology, 81, 459-473.
26. Huffcutt, A.I., Weekley, J., Wiesner, W.H. and DeGroot, T. (2001) Comparison of situational and behavior description interview questions for higher-level positions. Personnel Psychology, 54, 619-644.
27. Huffcutt, A.I. and Woehr, D.J. (1999) Further analysis of employment interview validity: A quantitative evaluation of interviewer-related structuring methods. Journal of Organizational Behavior, 20, 549-560.
28. Hunter, J.E. (1980) Test validation for 12,000 jobs: An application of synthetic validity and validity generalization to the General Aptitude Test Battery (GATB). Washington, DC: US Employment Service.
29. Hunter, J.E. and Hunter, R.F. (1984) Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72-98.
30. Hunter, J.E. and Schmidt, F.L. (1990) Methods of meta-anatysis: Correcting error and bias in research findings. Newbury Park, CA: Sage Publications.
31. Hunter, J.E., Schmidt, F.L. and Judiesch, M.K. (1990) Individual differences in output variability as a function of job complexity. Journal of Applied Psychology, 75, 28-42.
32. Janz, T. (1982) Initial comparisons of patterned behavior description interviews versus unstructured interviews. Journal of Applied Psychology, 67, 577-580.
33. Janz, T. (1989) The patterned behavior description interview: The best prophet of the future is the past. In R.W. Eder and G.R. Ferris (Eds.), The employment interview: Theory, research, and practice (pp. 158-168). Newbury Park, CA: Sage.
34. Johnson, E.K. (1990) The structured interview: Manipulating structuring criteria and the effects on validity, reliability, and practicality. Unpublished doctoral dissertation, Tulane University.
35. Kennedy, R.L. (1986) An investigation of criterion-related validity for the structured interview. Unpublished master's thesis, East Carolina University, Greenville, NC.
36. Kleinmann, M. and Deller, J. (1993) Das Situative Interview. In A. Gebert and W. Hacker (Eds.), 1. Deutscher Psychologentag (pp. 336-343). Bonn, Germany: Deutscher Psychologen Verlag GmbH.
37. Kleinmann, M. and Klehe, U. (2001, September) Erfolg im Situativen Interview: Verhalten sich Bewerber so wie von ihnen angegeben? [Success in the situational interview: Do applicants actually do what they said they would do?]. Paper presented at the 2nd Annual Meeting of the Society of Industrial and Organizational Psychology of the German Psychological Association, Nürnberg, Germany.
38. Latham, G.P. (1989) The reliability, validity, and practicality of the situational interview. In R.W. Eder and G.R. Ferris (Eds.), The employment interview: Theory, research, and practice (pp. 169-182). Newbury Park, CA: Sage.
39. Latham, G.P. and Saari, L.M. (1984) Do people do what they say? Further studies of the situational interview. Journal of Applied Psychology, 69, 569-573.
40. Latham, G.P., Saari, L.M., Pursell, E.D. and Campion, M.A. (1980) The situational interview. Journal of Applied Psychology, 65, 422-427.
41. Latham, G.P and Skarlicki, D. (1995) Criterion-related validity of the situational and patterned behavior description interviews with organizational citizenship behavior. Human Performance, 8, 67-80.
42. Latham, G.P. and Sue-Chan, C. (1999) A meta-analysis of the situational interview: An enumerative review of reasons for its validity. Canadian Psychology, 40, 56-67.
43. Lin, T.-R. and Adrian, N. (1993, May) Multi-method multidimension structure interviewing: A field study. Paper presented at the 8th Annual Conference of the Society for Industrial and Organizational Psychology, San Francisco, CA.
44. Little, J.P., Shoenfelt, E.L. and Brown, R.D. (2000) The situational versus the patterned-behavior-description interview for predicting customer-service performance. Paper presented at the 15th Annual Conference of the Society for Industrial and Organizational Psychology, New Orleans.
45. McDaniel, M.A., Whetzel, D.L., Schmidt, F.L. and Maurer, S.D. (1994) The validity of employment interviews: A comprehensive review and meta-analysis. Journal of Applied Psychology, 79, 599-616.
46. Morgeson, F.P., Reider, M.H. and Campion, M.A. (2002) Selecting individuals in team settings: Comparing a structured interview, personality test, and teamwork ability tests. Manuscript submitted for publication.
47. Moser, K. and Schuler, H. (2001) Validity of behavioral and situational interview questions; A reanalysis of the Schuler et al. (1995) data. Unpublished report. Universität Erlangen-Nürnberg and Universität Hohenheim, Germany.
48. Mosher, M.R. (1991, June) Development of a behaviorly consistent structured interview. Paper presented at the 27th International Applied Military Psychology Symposium, Stockholm, Sweden.
49. Motowidlo, S.J. (1999) Asking about past behavior versus hypothetical behavior. In R.W. Eder and M.M. Harris (Eds.), The employment interview handbook (pp. 179-90). Thousand Oaks, CA: Sage.
50. Motowidlo, S.J., Carter, G.W., Dunnette, M.D., Tippins, N., Werner, S., Burnett, J.R. and Vaughan, M.J. (1992) Studies of the structured behavioral interview. Journal of Applied Psychology, 77, 571-587.
51. Motowidlo, S.J. and Schmit, M.J. (1997) Performance assessment and interview procedures for store manager and store associate positions. Gainesville, FL: University of Florida Human Resource Research Center.
52. Organ, D.W. (1988) Organizational citizenship behavior. Lexington, MA: Lexington Books.
53. Orpen, C. (1985) Patterned behavior description interviews versus unstructured interviews; A comparative validity study. Journal of Applied Psychology, 70, 774-776.
54. Osburn, H.G. and Callender, J. (1992) A note on the sampling variance of the mean uncorrected correlation in meta-analysis and validity generalization. Journal of Applied Psychology, 77, 115-122.
55. Podsakoff, P.M., MacKenzie, S.B., Paine, J.P. and Bachrach, D.G. (2000) Organizational citizenship behaviors: A critical review of the theoretical and empirical literature and suggestions for future research. Journal of Management, 26, 513-563.
56. Pulakos, E.D. and Schmitt, N. (1995) Experience-based and situational interview questions: Studies of validity. Personnel Psychology, 48, 289-308.
57. Robertson, I.T., Gratton, L. and Rout, U. (1990) The validity of situational interviews for administrative jobs. Journal of Organizational Behavior, 11, 69-76.
58. Roth, P.L., Bobko, P., Switzer, F.S. III and Dean, M.A. (2001) Prior selection causes biased estimates of standardized ethnic group differences: Simulation and analysis. Personnel Psychology, 54, 591-617.
59. Rothstein, H.R. (1990) Interrater reliability of job performance ratings: Growth to asymptote level with increasing opportunity to observe. Journal of Applied Psychology, 75, 322-327.
60. Salgado, J.F. (1999) Personnel selection methods. In C.L. Cooper and I.T. Robertson (Eds.), International Review of Industrial and Organizational Psychology, 12, 1-53.
61. Salgado, J.F. and Moscoso, S. (1995) Validez de las entrevistas conductuales estructuradas [Validity of the behavior structured interview]. Revista de Psicologia del Trabajo y las Organizaciones, 11, 9-24.
62. Salgado, J.F. and Moscoso, S. (2002) Comprehensive meta-analysis of the construct validity of the employment interviews. European Journal of Work and Organizational Psychology, 11, 299-324.
63. Schmidt, F.L. and Hunter, J.E. (1998) The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262-274.
64. Schmit, M.J. and Motowidlo, S.J. (1995) Development and validation of a situational interview and personality test for selecting sales associates. Gainesville, FL: University of Florida Human Resource Research' Center.
65. Schmitt, N., Gooding, R.Z., Noe, R.A. and Kirsch, M. (1984) Metaanalyses of validity studies published between 1964 and 1982 and the investigation of study characteristics. Personnel Psychology, 37, 407-422.
66. Schuler, H. and Funke, U. (1989) The interview as a multimodal procedure. In R.W. Eder and G.R. Ferris (Eds.), The employment interview: Theory, research, and practice (pp. 183-192). Newbury Park, CA: Sage.
67. Schuler, H., Funke, U., Moser, K. and Donat, M. (1995) Personalauswahl in Forschung und Entwicklung. Eignung und Leistung von Wissenschaftlern und Ingenieuren. [Personnel selection in research and development. Aptitudes and performance of scientists and engineers]. Göttingen, Germany: Hogrefe.
68. Schuler, H., Moser, K., Diemand, A. and Funke, U. (1995) Validität eines Einstellungsinterviews zur Prognose des Ausbildungser-folgs [Validity of an employment interview for the prediction of training success]. Zeitschrift für Pädagogische Psychologie [German Journal of Educational Psychology], 9, 45-54. (Same study as Schuler & Funke 1989.)
69. Schuler, H. and Prochaska, M. (1990) Empirische Untersuchung der Leistungsmotivation in Einstellungsinterviews [Empirical investigation of achievement motivation in selection interviews]. Unpublished data, Universität Hohenheim, Germany.
70. Stohr-Gillmore, M.K., Stohr-Gillmore, M.W. and Kistler, N. (1990) Improving selection outcomes with the use of situational interviews: Empirical evidence from a study of correctional officers for new generation jails. Review of Public Personnel Administration, 10(2), 1-18.
71. Sue-Chan, C., Latham, G.P. and Evans, M.G. (1995) The construct validity of the situational interview and patterned behavior description interviews: Cognitive ability, tacit knowledge, and self-efficacy as correlates. Paper presented at the Annual Meeting of the Canadian Psychological Association, Charlottetown, Prince Edwards Island.
72. Tarico, V.S., Altmaier, E.M., Smith, W.L., Franken, E.A. and Berbaum, K.S. (1986) Development and validation of an accomplishment interview for radiology residents. Journal of Medical Education, 61, 845-847.
73. Taylor, P. and Small, B. (2002) Asking applicants what they would do versus what they did do: A meta-analytic comparison of situational and past behaviour employment interview questions. Journal of Occupational and Organizational Psychology, 75, 277-294.
74. US Department of Labor, Employment and Training Administration (1977) Dictionary of occupational titles (4th Edn.). Washington, DC: Government Printing Office.
75. US Office of Personnel Management (1987) The structured interview. Office of Examination Development, Alternative Examining Procedures Division. Washington, DC.
76. Vishwesvaran, C., Ones, D.S. and Schmidt,. F.L. (1996) Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology, 81, 557-574.
77. Weekley, J.A. and Gier, J.A. (1987) Reliability and validity of the situational interview for a sales position. Journal of Applied Psychology, 72, 484-487.
78. Wiesner, W. and Cronshaw, S. (1988) A meta-analytic investigation of the impact of interview format and degree of structure on the validity of the employment interview. Journal of Occupational Psychology, 61, 275-290.