What would you do - Really or ideally? Constructs underlying the behavior description interview and the situational interview in predicting typical versus maximum performance

Human Performance

Volumn 19, Issue 4, 2006, Pages 357-382

  Klehe, Ute Christine ^a,c   Latham, Gary ^b  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b UNIVERSITY OF TORONTO   (Canada)

^c Programmagroep A and O Psychologie   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 33845937154     PISSN: 08959285     EISSN: None     Source Type: Journal    
DOI: 10.1207/s15327043hup1904_3     Document Type: Article

References (86)

1. Ackerman, P. L., & Humphreys, L. G. (1990). Individual differences in industrial and organizational psychology. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology, Vol. 1 (2nd ed., pp. 223-282). Palo Alto, CA: Consulting Psychologists Press.
2. Allred, B. B., Snow, C. C., & Miles, R. E. (1996). Characteristics of managerial careers in the 21st century. Academy of Management Executive, 10, 17-27.
3. Arthur, W., Woehr, D. J., & Maldegen, R. (2000). Convergent and discriminant validity of assessment center dimensions: A conceptual and empirical reexamination of the assessment center construct-related validity paradox. Journal of Management, 26, 813-835.
4. Arvey, R. D., & Murphy, K. R. (1998). Performance evaluation in work settings. Annual Review of Psychology, 49, 141-168.
5. Arvey, R. D., Strickland, W., Drauden, G., & Martin, C. (1990). Motivational components of test taking. Personnel Psychology, 43, 695-716.
6. Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice Hall.
7. Bandura, A. (2000). Social cognitive theory: An agentic perspective. Annual Review of Psychology, 52, 1-26.
8. Binning, J. F., & Barrett, G. V. (1989). Validity of personnel decisions: A conceptual analysis of the inferential and evidential bases. Journal of Applied Psychology, 74, 478-494.
9. Borman, W. C. (1991). Job behavior, performance, and effectiveness. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology, Vol. 2 (2nd ed., pp. 271-326). Palo Alto, CA: Consulting Psychologists Press.
10. Boudreau, J. W. (1991). Utility analysis for decisions in human resource management, In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology, Vol. 2 (2nd ed., pp. 621-745). Palo Alto, CA: Consulting Psychologists Press.
11. Brodbeck, F. C., Frese, M., Akerblom, S., Audia, G., Bakacsi, G., Bendova, H., et al. (2000). Cultural variation of employeeship prototypes across 22 European countries. Journal of Occupational & Organizational Psychology, 73, 1-29.
12. Campbell, J. P. (1990). Modeling the performance prediction problem in industrial and organizational psychology. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology, Vol. I (2nd ed., pp. 687-732). Palo Alto, CA: Consulting Psychologists Press.
13. Campion, M. A., Palmer, D. K., & Campion, J. E. (1997). A review of structure in the selection interview. Personnel Psychology, 50, 655-702.
14. Cascio, W. F. (1998). Applied psychology in human resource management (5th ed.). Upper Saddle River, NJ: Prentice Hall.
15. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
16. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159.
17. Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
18. Conway, J. M., Jako, R. A., & Goodman, D. F. (1995). A meta-analysis of interrater and internal consistency reliability of selection interviews. Journal of Applied Psychology, 80, 565-579.
19. Conway, J. M., & Peneno, G. M. (1999). Comparing structured interview question types: Construct validity and applicant reactions. Journal of Business and Psychology, 13, 485-506.
20. Cronbach, L. J. (1960). Essentials of psychological testing (2nd ed.). Oxford, England: Harper & Row.
21. Dewberry, C. (2001). Performance disparities between Whites and ethnic minorities: Real differences or assessment bias? Journal of Occupational and Organizational Psychology, 74, 659-673.
22. Dipboye, R. L. (1994). Structured selection interviews: Why do they work? Why are they underutilized? In N. Anderson & P. Herriot (Eds.), International handbook of selection and assessment (pp. 455-473). New York: Wiley.
23. Druskat, V. U., & Wolff, S. B. (1999). Effects and timing of developmental peer appraisals in self-man-aging work groups. Journal of Applied Psychology, 84, 58-74.
24. DuBois, C. L. Z., Sackett, P. R., Zedeck, S., & Fogli, L. (1993). Further exploration of typical and maximum performance criteria: Definitional issues, prediction, and White-Black differences. Journal of Applied Psychology, 78, 205-211.
25. Fishbein, M., & Ajzen, I. (1975). Belief, attitude, intention and behavior: An introduction to theory and research. Reading, MA: Addison-Wesley.
26. Flanagan, J. C. (1954). The critical incident technique. Psychological Bulletin, 51, 327-358.
27. Guion, R. M. (1991). Personnel assessment, selection, and placement. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology. Vol. 2 (2nd ed., pp. 327-397). Palo Alto, CA: Consulting Psychologists Press.
28. Guion, R. M. (1998). Assessment, measurement, and prediction for personnel decisions. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
29. Hotelling, H. (1940). The selection of variates for use in prediction, with some comments on the general problem of nuisance parameters. Annals of Mathematical Statistics, 11, 271-283.
30. Huffcutt, A. I., & Arthur, W. (1994). Hunter and Hunter (1984) revisited: Interview validity for entry-level jobs. Journal of Applied Psychology, 79, 184-190.
31. Huffcutt, A. I., Conway, J. M., Roth, P. L., & Klehe, U.-C. (2004). Evaluation and comparison of the situational and behavior description interview formats. International Journal of Selection and Assessment, 12, 262-273.
32. Huffcutt. A. I., Conway, J. M., Roth, P. L., & Stone, N. J. (2001). Identification and meta-analytic assessment of psychological constructs measured in employment interviews. Journal of Applied Psychology, 86, 897-913.
33. Huffcutt, A. I., Roth, P. L., & McDaniel, M. A. (1996). A meta-analytic investigation of cognitive ability in employment interview evaluations: Moderating characteristics and implications for incremental validity. Journal of Applied Psychology, 81, 459-473.
34. Huffcutt, A. I., Weekley, J. A., Wiesner, W. H., Degroot, T. G., & Jones, C. (2001). Comparison of situational and behavior description interview questions for higher-level positions. Personnel Psychology, 54, 619-644.
35. Huffcutt, A. I., & Woehr, D. J. (1999). Further analysis of employment interview validity: A quantitative evaluation of interviewer-related structuring methods. Journal of Organizational Behavior, 20, 549-560.
36. Janz, T. (1982). Initial comparisons of patterned behavior description interviews versus unstructured interviews. Journal of Applied Psychology, 67, 577-580.
37. Janz, T. (1989). The patterned behavior description interview: The best prophet of the future is the past. In R. W. Eder & G. R. Ferris (Eds.), The employment interview: Theory, research, and practice (pp. 158-168). Thousand Oaks, CA: Sage.
38. Kirk, A. K., & Brown, D. F. (2003). Latent constructs of proximal and distal motivation predicting performance under maximum test conditions. Journal of Applied Psychology, 88, 40-49.
39. Klehe, U.-C., & Anderson, N. (2004, April). Motivation and ability during typical and maximum performance. A test of the underlying assumptions. Paper presented at the 19th annual meeting of the Society of Industrial and Organizational Psychology, Chicago.
40. Klehe, U.-C., & Anderson, N. (2005). The prediction of typical and maximum performance. In A. Evers, N. Anderson, & O. Smit-Voskuijl (Eds.), Handbook of personnel selection (pp. 331-353). Oxford, England: Blackwell.
41. Klehe, U.-C., & Latham, G. P. (2005). The predictive and incremental validity of the situational and patterned behavior description interviews for team playing behavior. International Journal of Selection and Assessment, 13, 108-115.
42. Klimoski, R., & Brickner, M. (1987). Why do assessment centers work? The puzzle of assessment center validity. Personnel Psychology, 40, 243-260.
43. Latham, G. P. (1989). The reliability, validity, and practicality of the situational interview. In R. W. Eder & G. R. Ferris (Eds.), The employment interview: Theory, research, and practice (pp. 169-182). Thousand Oaks, CA: Sage.
44. Latham, G. P., & Finnegan, B. J. (1993). Perceived practicality of unstructured, patterned, and situational interviews. In H. Schuler, J. L. Farr, & M. Smith (Eds.), Personnel selection and assessment: Individual and organizational perspectives (pp. 41-55). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
45. Latham, G. P., Saari, L. M., Pursell, E. D., & Campion, M. A. (1980). The situational interview. Journal of Applied Psychology, 65, 422-427.
46. Latham, G. P., & Skarlicki, D. P. (1995). Criterion-related validity of the situational and patterned behavior description interviews with organizational citizenship behavior. Human Performance, 8, 67-80.
47. Latham, G. P., & Sue-Chan, C. (1999). A meta-analysis of the situational interview: An enumerative review of reasons for its validity. Canadian Psychology, 40, 56-67.
48. Latham, G. P., & Wexley, K. N. (1977). Behavioral observation scales for performance appraisal purposes. Personnel Psychology, 30, 255-268.
49. Latham, G. P., & Wexley, K. N. (1994). Increasing productivity through performance appraisal (2nd ed.). Reading, MA: Wesley Publishing Company.
50. Lewin, K. (1951). Field theory in social science: selected theoretical papers (D. Cartwright, Ed.). Oxford, England: Harpers & Brothers.
51. Locke, E. A., & Latham, G. P. (1990). A theory of goal setting & task performance. Upper Saddle River, NJ: Prentice Hall.
52. Locke, E. A., Mento, A. J., & Katcher, B. L. (1978). The interaction of ability and motivation in performance: An exploration of the meaning of moderators. Personnel Psychology, 31, 269-280.
53. Louis, M. R. (1980). Surprise and sense making: What newcomers experience in entering unfamiliar organizational settings. Administrative Science Quarterly, 25, 226-251.
54. Love, K. G. (1981). Comparison of peer assessment methods: Reliability, validity, friendship bias, and user reaction. Journal of Applied Psychology, 66, 451-457.
55. Maier, N. R. F. (1955). Psychology in industry (2nd ed.). Oxford, England: Houghton Mifflin.
56. Maurer, S. D., Sue-Chan, C., & Latham, G. P. (1999). The situational interview. In R. W. Eder & M. M. Harris (Eds.), The employment interview handbook (pp. 159-177). Thousand Oaks, CA: Sage.
57. McCloy, R. A., Campbell, J. P., & Cudeck, R. (1994). A confirmatory test of a model of performance determinants. Journal of Applied Psychology, 79, 493-505.
58. Meng, X. L., Rosenthal, R., & Rubin, D. B. (1992). Comparing correlated correlation coefficients. Psychological Bulletin, 111, 172-175.
59. Mitchell, T. R. (1985). An evaluation of the validity of correlational research conducted in organizations. Academy of Management Review, 10, 192-205.
60. Moscoso, S. (2000). A review of validity evidence, adverse impact and applicant reactions. International Journal of Selection and Assessment, 8, 237-247.
61. Mumford, M. D. (1983). Social comparison theory and the evaluation of peer evaluations: A review and some applied implications. Personnel Psychology, 36, 867-881.
62. Olkin, I. (1967), Correlations revisited. In J. C. Stanley (Ed.), Improving experimental design and statistical analysis (pp. 102-128). Chicago: Rand McNally.
63. Orpen, C. (1985). Patterned behavior description interviews versus unstructured interviews: A comparative validity study. Journal of Applied Psychology, 70, 774-776.
64. Ployhart, R. E., Lim, B. C., & Chan, K. Y. (2001). Exploring relations between typical and maximum performance ratings and the five factor model of personality. Personnel Psychology, 54, 809-843.
65. Prentice, D. A., & Miller, D. T. (1992). When small effects are impressive. Psychological Bulletin, 112, 160-164.
66. Ryan, T. A. (1970). Intentional behavior: An approach to human motivation. Oxford, England: Ronald Press.
67. Sackett, P. R., & Dreher, G. F. (1982). Constructs and assessment center dimensions: Some troubling empirical findings. Journal of Applied Psychology, 67, 401-410.
68. Sackett, P. R., & Larson, J. R., Jr. (1990). Research strategies and tactics in industrial and organizational psychology. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology, Vol. 1 (2nd ed., pp. 419-489). Palo Alto, CA: Consulting Psychologists Press.
69. Sackett, P. R., Zedeck, S., & Fogli, L. (1988). Relations between measures of typical and maximum job performance. Journal of Applied Psychology, 73, 482-486.
70. Salgado, J. F., & Moscoso, S. (2002). Comprehensive meta-analysis of the construct validity of the employment interview. European Journal of Work and Organizational Psychology, 11, 299-324.
71. Schneider, J. R., & Schmitt, N. (1992). An exercise design approach to understanding assessment center dimension and exercise constructs. Journal of Applied Psychology, 77, 32-41.
72. Schuler, H., Frier, D., & Kauffmann, M. (1993). Personalauswahl im europäischen vergleich [Personnel selection: A European comparison]. Göttingen, Germany: Verlag für angewandte Psychologie.
73. Schuler, H., & Funke, U. (1989). The interview as a multimodal procedure. In R. W. Eder & G. R. Ferris (Eds.), The employment interview: Theory, research, and practice (pp. 183-192). Thousand Oaks, CA: Sage.
74. Smith-Jentsch, K. A., Salas, E., & Brannick, M. T. (2001). To transfer or not to transfer? Investigating the combined effects of trainee characteristics, team leader support, and team climate. Journal of Applied Psychology, 86, 279-292.
75. Sue-Chan, C., & Latham, G. P. (2004). The relative effectiveness of external, peer, and self coaches. Applied Psychology: An International Review, 53, 260-278.
76. Tabachnick, B. G., & Fidell, L. S. (2001). Using multivariate statistics. Needham Heights. MA: Allyn & Bacon.
77. Taylor, P. J., & Small, B. (2002), Asking applicants what they would do versus what they did do: A meta-analytic comparison of situational and past behaviour employment interview questions. Journal of Occupational and Organizational Psychology, 75, 277-294.
78. Terpstra, D. E., Mohamed, A. A., & Kethley, R. B. (1999). An analysis of federal court cases involving nine selection devices. International Journal of Selection and Assessment, 7, 26-34.
79. Thorsteinson, T. J., & Balzer, W. K. (1999). Effects of coworker information on perceptions and ratings of performance. Journal of Organizational Behavior, 20, 1157-1173.
80. Tziner, A., & Kopelman, R. (1988). Effects of rating format on goal-setting dimensions: A field experiment. Journal of Applied Psychology, 73, 323-326.
81. Tziner, A., Kopelman, R. E., & Livneh, N. (1993). Effects of performance appraisal format on perceived goal characteristics, appraisal process satisfaction, and changes in rated job performance: A field experiment. Journal of Psychology, 127, 281-291.
82. Van Iddekinge, C. H., Raymark, P. H., Eidson, C. E., & Attenweiler, W. J. (2004). What do structured selection interviews really measure? The construct validity of behavior description interviews. Human Performance, 17, 71-93.
83. Van Iddekinge, C. H., Raymark, P. H., & Roth, P. L. (2005). Assessing personality with a structured employment interview: Construct-related validity and susceptibility to response inflation. Journal of Applied Psychology, 90, 536-552.
84. Viswesvaran, C., & Ones, D. S. (2005). Job performance: Assessment issues in personnel selection. In A. Evers, N. Anderson, & O. Smit-Voskuijl (Eds.), Handbook of personnel selection (pp. 354-375). Oxford, England: Blackwell.
85. Wiesner, W. H., & Cronshaw, S. F. (1988). A meta-analytic investigation of the impact of interview format and degree of structure on the validity of the employment interview. Journal of Occupational Psychology, 61, 275-290.
86. Williams, E. J. (1959). The comparison of regression variables. Journal of the Royal Statistical Society, 21, 396-399.