The variability of criterion-related validity estimates among interviewers and interview panels

International Journal of Selection and Assessment

Volumn 14, Issue 3, 2006, Pages 193-205

  Vanlddekinge, Chad H ^a   Sager, Christopher E ^b   Burnfield, Jennifer L ^b   Heffner, Tonia S ^c  

^a FLORIDA STATE UNIVERSITY   (United States)

^b HUMAN RESOURCES RESEARCH ORGANIZATION   (United States)

^c US Army Research Institute for the Behavioral and Social Sciences   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 33845401354     PISSN: 0965075X     EISSN: 14682389     Source Type: Journal    
DOI: 10.1111/j.1468-2389.2006.00352.x     Document Type: Article

References (36)

1. Arbuckle, J.L. (2003) AMOS 5.0 user's guide. Chicago: Small-waters.
2. Arvey, R.D. and Campion, J.E. (1982) The employment interview: A summary and review of recent literature. Personnel Psychology, 35, 281-322.
3. Bobko, P., Roth, P.L. and Potosky, D. (1999) Derivation and implications of a meta-analytic matrix incorporating cognitive ability, alternative predictors, and job performance. Personnel Psychology, 52, 561-589.
4. Bommer, W.H., Johnson, J. and Rich, G.A. (1995) On the interchangeability of objective and subjective measures of employee performance: A meta-analysis. Personnel Psychology, 48, 587-605.
5. Campbell, J.P. (1990) Modeling the performance prediction problem in industrial organizational psychology. In M.D. Dunnette and L.M. Hough (Eds), Handbook of industrial and organizational psychology, Vol. 1, 2nd Edn (pp. 687-732). Palo Alto: Consulting Psychologists Press.
6. Campbell, J.P. and Knapp, D.J. (2001) Exploring the limits in personnel selection and classification. Mahwah, NJ: Lawrence Erlbaum Associates Inc.
7. Campbell, J.P., McCloy, R.A., Oppler, S.H. and Sager, C.E. (1993) A theory of performance. In N. Schmitt and W. Borman (Eds), Personnel selection in organizations (pp. 35-70). San Francisco: Jossey-Bass.
8. Campion, M.A., Palmer, D.K. and Campion, J.E. (1997) A review of structure in the selection interview. Personnel Psychology, 50, 655-702.
9. Cohen, J. and Cohen, P. (1983) Applied multiple regression/correlation analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum.
10. Conway, J.M., Jako, R.A. and Goodman, D.F. (1995) A meta-analysis of interrater and internal consistency reliability of selection interviews. Journal of Applied Psychology, 80, 565-579.
11. Dipboye, R.L. (1992) Selection interviews: Process perspectives. Cincinnati, OH: South-Western.
12. Dipboye, R.L., Gaugler, B.B., Hayes, T.L. and Parker, D. (2001) The validity of unstructured panel interviews: More than meets the eye? Journal of Business and Psychology, 16, 35-49.
13. Dougherty, T.W., Ebert, R.J. and Callender, J.C. (1986) Policy capturing in the employment interview. Journal of Applied Psychology, 71, 9-15.
14. Dreher, G.F., Ash, R.A. and Hancock, P. (1988) The role of the traditional research design in underestimating the validity of the employment interview. Personnel Psychology, 41, 315-327.
15. Gehrlein, T.M., Dipboye, R.L. and Shahani, C. (1993) Nontraditional validity calculations and differential interviewer experience: Implications for selection interviews. Educational and Psychological Measurement, 52, 457-469.
16. Graves, L.M. (1993) Sources of individual differences in interviewer effectiveness: A model and implications for future research. Journal of Organizational Behavior, 14, 349-370.
17. Graves, L.M. and Karren, R.J. (1992) Interviewer decision processes and effectiveness: An experimental policy-capturing investigation. Personnel Psychology, 45, 313-340.
18. Graves, L.M. and Karren, R.J. (1999) Are some interviewers better than others? In R.W. Eder and M.M. Harris (Eds), The employment interview handbook (pp. 243-258). Thousand Oaks, CA: Sage.
19. Heneman, R.L. (1986) The relationship between supervisory ratings and results-oriented measures of performance: A meta-analysis. Personnel Psychology, 39, 811-826.
20. Huffcutt, A.I. and Arthur, W. Jr (1994) Hunter and Hunter (1984) revisited: Interview validity for entry-level jobs. Journal of Applied Psychology, 79, 184-190.
21. Hunter, J.E. and Schmidt, F.L. (2004) Methods of meta-analysis: Correcting for error and bias in research findings. Thousand Oaks, CA: Sage.
22. Kinicki, A.J., Lockwood, C.A., Horn, P.W. and Griffeth, R.W. (1990) Interviewer predictions of applicant qualifications and interviewer validity: Aggregate and individual analyses, Journal of Applied Psychology, 75, 477-486.
23. Knapp, D.J., McCloy, R.A. and Heffner, T.S. (Eds). (2004) Validation of measures designed to maximize 21st-century Army NCO performance (technical report 1145). Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences.
24. McDaniel, M.A., Whetzel, D.L., Schmidt, F.L. and Maurer, S. (1994) The validity of employment interviews: A comprehensive review and meta-analysis. Journal of Applied Psychology, 79, 599-616.
25. Milia, L.E. and Gorodecki, M. (1997) Some factors explaining the reliability of a structured interview system at a work site. International Journal of Selection and Assessment, 5, 193-199.
26. Osborn, S.M., Field, H.S. and Veres, J.G. (1998) Introversion- extraversion, self-monitoring, and applicant performance in a situational panel interview: A field study. Journal of Business and Psychology, 13, 143-156.
27. Pulakos, E.D., Schmitt, N., Whitney, D. and Smith, M. (1996) Individual differences in interviewer ratings: The impact of standardization, consensus discussion, and sampling error on the validity of a structured interview. Personnel Psychology, 49, 85-102.
28. Roth, P.L. and Campion, J.E. (1992) An analysis of the predictive power of the panel interview and pre-employment tests. Journal of Occupational and Organizational Psychology, 65, 51-60.
29. Roth, P.L., Van Iddekinge, C.H., Huffcutt, A.I., Eidson, C.E. Jr and Bobko, P. (2002) Correcting for range restriction in structured interview ethnic group differences: The values may be larger than researchers thought. Journal of Applied Psychology, 87, 369-376.
30. Van der Zee, K.I., Bakker, A.B. and Bakker, P. (2002) Why are structured interviews so rarely used in personnel selection? Journal of Applied Psychology, 87, 176-184.
31. Van Iddekinge, C.H., Raymark, P.H., Eidson, C.E. Jr and Attenweiler, B. (2004) What do structured interviews really measure? The construct validity of behavior description interviews. Human Performance, 17, 71-93.
32. Viswesvaran, C., Ones, D.S. and Schmidt, EL. (1996) Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology, 81, 557-574.
33. Viswesvaran, C., Schmidt, F.L. and Ones, D.S. (2005) Is there a general factor in ratings of job performance? A meta-analytic framework for disentangling substantive and error influences. Journal of Applied Psychology, 90, 108-131.
34. Wilk, S.L. and Cappelli, P. (2003) Understanding the determinants of employer use of selection methods. Personnel Psychology, 56, 103-124.
35. Williamson, L.G., Campion, J.E., Malos, S.B., Roehling, M.V. and Campion, M.A. (1997) Employment interview on trial: Linking interview structure with litigation outcomes. Journal of Applied Psychology, 82, 900-912.
36. Zedeck, S., Tziner, A. and Middlestadt, S.E. (1983) Interviewer validity and reliability: An individual analysis approach. Personnel Psychology, 36, 355-370.