Revisiting interview-cognitive ability relationships: Attending to specific range restriction mechanisms in meta-analysis

Personnel Psychology

Volumn 60, Issue 4, 2007, Pages 837-874

  Berry, Christopher M ^a,b,c   Sackett, Paul R ^a   Landers, Richard N ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

^b WAYNE STATE UNIVERSITY   (United States)

^c WAYNE STATE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 36248930061     PISSN: 00315826     EISSN: 17446570     Source Type: Journal    
DOI: 10.1111/j.1744-6570.2007.00093.x     Document Type: Article

References (94)

1. Adoption of Additional Questions and Answers To Clarify and Provide a Common Interpretation of the Uniform Guidelines on Employee Selection Procedures as They Relate to the Internet and Related Technologies, 69 Fed Reg. 10152-10158 (Mar. 4, 2004).
2. *Albrecht PA, Glaser EM, Marks J 1964). Validation of a multiple-assessment procedure for managerial personnel. Journal of Applied Psychology, 48, 351 360.
3. Arthur W, Day EA, McNelly TL, Edens PS 2003). A meta-analysis of the criterion-related validity of assessment center dimensions. Personnel Psychology, 56, 125 154.
4. *Bass BM 1949). Comparison of the leaderless group discussion and the individual interview in the selection of sales and management trainees. Unpublished dissertation, Ohio State University.
5. *Berkley S 1984). VII. Validation report corrections officer trainee. Harrisburg, PA : Commonwealth of Pennsylvania Civil Service Commission.
6. *Bosshardt MJ 1994). Situational interviews versus behavior description interviews: A comparative validity study. Unpublished dissertation, University of Minnesota.
7. *Bradley KM, Bernthal PR, Thomas JN 1998, May). Factor structure and predictive validity of structured employment interviews: An application of industrial psychology in a Kuwaiti petrochemical corporation. Poster presented at the 13th Annual Conference of the Society for Industrial and Organizational Psychology Dallas, TX.
8. *Calkins EV, Richards JM, McCanse A, Burgess MM, Willoughby TL 1974). Impact on admission to a school of medicine of an innovation in selection procedures. Psychological Reports, 35, 1135 1142.
9. *Campbell JT, Prien EP, Brailey LG 1960). Predicting performance evaluations. Personnel Psychology, 13, 435 440.
10. *Campion MA, Campion JE, Hudson JP, Jr. 1994). Structured interviewing: A note on incremental validity and alternative question types. Journal of Applied Psychology, 79, 998 1102.
11. *Campion MA, Pursell ED, Brown BK 1988). Structured interviewing: Raising the psychometric properties of the employment interview. Personnel Psychology, 41, 25 42.
12. *Conway JM, Peneno GM 1999). Comparing structured interview question types: Construct validity and applicant reactions. Journal of Business and Psychology, 13, 485 506.
13. Conway JM, Jako RA, Goodman DF 1995). A meta-analysis of interrater and internal consistency reliability of selection interviews. Journal of Applied Psychology, 80, 565 579.
14. Cortina JM, Goldstein NB, Payne SC, Davison HK, Gilliland SW 2000). The incremental validity of interview scores over and above g and conscientiousness scores. Personnel Psychology, 53, 325 351.
15. *Davey B 1984, June). Are all oral panels created equal? Paper presented at the Annual Conference of the International Personnel Management Association Assessment Council, Seattle, WA.
16. *Delery JE, Wright PM, McArthur K, Anderson DC 1994). g tests and the situational interview: A test of incremental validity. International Journal of Selection and Assessment, 2, 53 58.
17. *Denning DL 1993). An initial investigation of constructs assessed in employment interviews. Paper presented at the 8th Annual Conference of the Society for Industrial and Organizational Psychology, San Francisco.
18. *Dicken C 1969). Predicting the success of Peace Corps community development workers. Journal of Consulting and Clinical Psychology, 33, 597 606.
19. *Dipboye RL, Gaugler BB, Hayes TL, Parker DS 1992). Individual differences in the incremental validity of interviewers' judgments. Unpublished manuscript.
20. Drasgow F 2003). Intelligence and the workplace. In Borman WC, Ilgen DR, Klimoski RJ (Eds. Handbook of psychology: Volume 12, industrial and organizational psychology (pp. 107 130 Hoboken, NJ : Wiley.
21. *Durivage A, St. Martin J, Barrette J 1995). Intelligence pratique ou traditionnelle: Que mesure l'entrevue structure situationnelle? European Review of Applied Psychology, 45, 171 178.
22. *Elam CL, Andrykowski MA 1991). Admission interview ratings: Relationship to applicant academic and demographic variables and interviewer characteristics. Academic Medicine, 66, 13 15.
23. *Elliot AGP 1981). Sex and decision making in the selection interview: A real-life study. Journal of Occupational Psychology, 54, 365 273.
24. *Fox S, Spector PE 2000). Relations of emotional intelligence, practical intelligence, general intelligence, and trait affectivity with interview outcomes: It's not all just "G". Journal of Organizational Behavior, 21, 203 220.
25. Friedland D 1973). Selection of police officers. Los Angeles, CA : City of Los Angeles, Personnel Department.
26. *Friedland D 1976). Section II - City of Los Angeles Personnel Department: Junior Administrative Assistant Validation Study. Los Angeles : City of Los Angeles Personnel Department.
27. *Friedland D 1980). A predictive validity study of selected tests for police officer selection. Los Angeles : City of Los Angeles Personnel Department.
28. Ghiselli EE, Campbell JP, Zedeck S 1981). Measurement theory for the behavioral sciences. San Francisco. W. H. Freeman & Co.
29. Gowing MK, Slivinski LW 1994). A review of North American selection procedures: Canada and the United States of America. International Journal of Selection and Assessment, 2, 103 114.
30. Gulliksen H 1950). Theory of mental tests. New York : Wiley.
31. *Handyside JD, Duncan DC 1954). Four years later: A follow-up of an experiment in selecting supervisors. Occupational Psychology, 28, 9 23.
32. *Hilliard PA 2000). Comparison of the predictive validity of a written test, an integrity test, a conscientiousness questionnaire, a structured behavioral interview and personality inventory in the assessment of job applicants' background investigations, and subsequent task and contextual job performance. Unpublished dissertation.
33. Huffcutt A, Arthur W, Jr. 1994). Hunter and Hunter (1984) revisited: Interview validity for entry-level jobs. Journal of Applied Psychology, 79, 184 190.
34. Huffcutt AI, Conway JM, Roth PL, Stone NJ 2001). Identification and meta-analytic assessment of psychological constructs measured in employment interviews. Journal of Applied Psychology, 86, 897 913.
35. Huffcutt AI, Roth PL, McDaniel MA 1996). A meta-analytic investigation of g in employment interview evaluations: Moderating characteristics and implications for incremental validity. Journal of Applied Psychology, 81, 459 473.
36. *Huffcutt AI, Weekly JA, Wiesner WH, Degroot TG, Jones C 2001). Comparison of situational and behavior description interview questions for higher-level positions. Personnel Psychology, 54, 619 644.
37. Hunter JE, Hunter RF 1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72 98.
38. Hunter JE, Schmidt FL 2004). Methods of meta-analysis (2nd ed.). Thousands Oaks, CA : Sage.
39. Hunter JE, Schmidt FL, Judiesch MK 1990). Individual differences in output variability as a function of job complexity. Journal of Applied Psychology, 75, 28 42.
40. Hunter JE, Schmidt FL, Le H 2006). Implications of direct and indirect range restriction for meta-analysis methods and findings. Journal of Applied Psychology, 91, 594 612.
41. *Huse EF 1962). Assessments of higher-level personnel: IV. The validity of assessment techniques based on systematically varied information. Personnel Psychology, 15, 195 205.
42. *Johnson EK 1990). The structured interview: Manipulating structuring criteria and the effects on validity, reliability, and practicality. Unpublished doctoral dissertation, Tulane University.
43. *Johnson EM, McDaniel MA 1981, June). Training correlates of a police selection system. Paper presented at the International Personnel Management Association conference, Denver, CO.
44. *Klehe UC 2003). Towards an understanding of the constructs underlying the situational interview and the patterned behavior description interview in predicting typical versus maximum performance. Unpublished dissertation.
45. Klehe UC, Koenig C, Melchers KG, Kleinmann M, Richter G, Vaccines C 2006, May). Candidates ability to identify criteria in structured interviews and its predictive power of performance in an assessment center. In Ferstle KL, Klehe UC (Chairs). New insights into constructs underlying structured interview performance and validity. Symposium presented at the 21st Annual Conference of the Society for Industrial and Organizational Psychology, Dallas, TX.
46. *Klehe UC, Latham GP 2005). The predictive and incremental validity of the situational and patterned behavior description interviews for teamplaying behavior. International Journal of Selection and Assessment, 13, 108 115.
47. *Largo E 1994). An assessment of the incremental validity of a structured employment interview. Unpublished dissertation.
48. *Lievens F, Harris MM, Van Keer E, Bisqueret C 2003). Predicting cross-cultural training performance: The validity of personality, g, and dimensions measured by an assessment center and a behavior description interview. Journal of Applied Psychology, 88, 476 489.
49. *Lopez FM 1966). Current problems in test performance of job applicants: I. Personnel Psychology, 19, 10 18.
50. *Loven MJ 1998). Selection factors related to satisfaction, persistence, and job performance for technical writers at the Iowa State University Child Welfare Project. Unpublished dissertation.
51. Marsden PV 1994). Selection methods in U.S. establishments. Acta Sociologica, 37, 287 301.
52. McDaniel MA, Whetzel DL, Schmidt FL, Mauer SD 1994). The validity of employment interviews: A comprehensive review and meta-analysis. Journal of Applied Psychology, 79, 599 616.
53. *Melchers KG, Klehe UC, Richter GM, Kleinmann M, Konig CJ 2005). The impact of interviewees' ability to identify criteria in structured interviews. Unpublished manuscript.
54. *Menkes J 2002). What do structured interviews actually measure? A construct validity study. Unpublished dissertation.
55. *Meredith KE, Dunlap MR, Baker HH 1982). Subjective and objective admissions factors as predictors of clinical clerkship performance. Journal of Medical Education, 57, 743 751.
56. *Motowidlo SJ, Carter GW, Dunnette MD, Tippins N, Werner S, Burnett JR, et al 1992). Studies of the structured behavioral interview. Journal of Applied Psychology, 77, 571 587.
57. *Newman SH, Bobbitt JM, Cameron DC 1946). The reliability of the interview method in an officer candidate evaluation program. American Psychologist, 1, 103 109.
58. Ones DS, Viswesvaran C, Schmidt FL 1993). Comprehensive meta-analysis of integrity test validities: Findings and implications for personnel selection and theories of job performance. Journal of Applied Psychology, 78, 679 703.
59. *Philips AP, Dipboye RL 1989). Correlational tests of predictions from a process model of the interview. Journal of Applied Psychology, 74, 41 52.
60. *Pulakos ED, Schmitt N 1995). Experience-based and situational interview questions: Studies of validity. Personnel Psychology, 48, 289 308.
61. *Pulakos ED, Schmitt N 1996). An evaluation of two strategies for reducing adverse impact and their effects on criterion-related validity. Human Performance, 9, 241 258.
62. *Reeb M 1969). A structured interview for predicting military adjustment. Occupational Psychology, 43, 193 199.
63. *Requate F 1972). Metropolitan Dade County Fire Fighter Validation Study. Miami, FL : City of Miami Personnel Department.
64. *Rhea BD, Rimland B, Githens WH 1965). The development and evaluation of a forced-choice letter of reference form for selecting officer candidates (Technical Bulletin STB 66-10). San Diego, CA : U.S. Naval Personnel Research.
65. *Roth PL, Campion JE 1992). An analysis of the predictive power of the panel interview and pre-employment tests. Journal of Occupational and Organizational Psychology, 65, 51 60.
66. Ryan AM, McFarland L, Baron H, Page R 1999). An international look at selection practices: Nation and culture as explanations for variability in practice. Personnel Psychology, 52, 359 391.
67. Sackett PR, Yang H 2000). Correction for range restriction: An expanded typology. Journal of Applied Psychology, 85, 112 118.
68. Sackett PR, Lievens F, Berry CM, Landers R 2007). A cautionary note on the effects of range restriction on interpredictor correlations. Journal of Applied Psychology, 92, 538 544.
69. Salgado JF, Moscoso S 1995). Validity of the behavior structured interviews. Psicologia del Trabajo y las Organizaciones, 11, 9 24.
70. Salgado JF, Moscoso S 2002). Comprehensive meta-analysis of the construct validity of the employment interview. European Journal of Work and Organizational Psychology, 11, 299 324.
71. Schmidt FL, Hunter JE 1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262 274.
72. Schmidt FL, Le HA 2004). Software for the Hunter-Schmidt Meta-Analysis methods [computer software]. Iowa City: University of Iowa. Department of Management and Organizations.
73. Schmidt FL, Oh IS, Le H 2006). Increasing the accuracy of corrections for range restriction: Implications for selection procedure validities and other research results. Personnel Psychology, 59, 281 305.
74. *Schuler H, Funke U 1989). The interview as a multimodal procedure. In Eder RW, Ferris GR (Eds. The employment interview: Theory, research, and practice (pp. 183 192). Newbury Park, CA : Sage.
75. *Shahani C, Dipboye RL, Gehrlein TM 1991). The incremental contribution of an interview to college admissions. Educational and Psychological Measurement, 51, 1049 1061.
76. *Sparks CP 1973a). Validity of a selection program for process trainees (Personnel Research No. 73-1). Unpublished manuscript.
77. *Sparks CP 1973b). Validity of a selection program for refinery technician trainees (Personnel Research No. 73-4). Unpublished manuscript no longer available for distribution.
78. *Sparks CP 1974). Validity of a selection program for commercial drivers (Personnel Research No. 74-9). Unpublished manuscript no longer available for distribution.
79. *Sparks CP 1978). Preemployment tests for pipefitter trainee (Personnel Research No. 78-19). Unpublished manuscript.
80. Steel PD, Kammeyer-Mueller JD 2002). Comparing meta-analytic moderator estimation techniques under realistic conditions. Journal of Applied Psychology, 87, 96 111.
81. *Sue-Chan C, Latham GP 2004). The situational interview as a predictor of academic and team performance: A study of the mediating effects of g and emotional intelligence. International Journal of Selection and Assessment, 12, 312 320.
82. Thorndike RL 1949). Personnel selection. New York : Wiley.
83. *Tubiana JH, Ben-Shakhar G 1982). An objective group questionnaire as a substitute for a personal interview in the prediction of success in military training in Israel. Personnel Psychology, 35, 349 357.
84. *Tziner A, Dolan S 1982). Validity of an assessment center for identifying future female officers in the military. Journal of Applied Psychology, 67, 728 736.
85. * U.S. Office of Personnel Management 1987). The structured interview. Washington, DC : Office of Examination Development, Alternative Examining Procedures Division.
86. *Van Iddekinge CH, Eidson CE, Jr. 2005). Using personality tests and structured interviews to select customer service managers. Unpublished manuscript, Clemson University.
87. *Van Iddekinge CH, Henry MS 2006, May). Are facets of cognitive ability differentially predictive of interview performance? In Ferstl K, Klehe UC (Chairs New insights into constructs underlying structured interview performance and validity. Symposium to be conducted at the 21st Annual Conference of the Society for Industrial and Organizational Psychology, Dallas, TX.
88. *Van Iddekinge CH, Roth PL, Sager CE, Heffner TS 2005). A construct-oriented investigation of a structured employment interview. Paper presented at the 20th Annual Conference of the Society for Industrial and Organizational Psychology, Los Angeles, CA.
89. *Vernon PE, Parry JB 1949). Personnel selection in the British forces. London : University of London Press.
90. *Villanova P, Bernardin HJ, Johnson DL, Dahmus SA 1994). The validity of a measure of job compatibility in the prediction of job performance and turnover of motion picture theater personnel. Personnel Psychology, 47, 73 90.
91. *Walters LC, Miller MR, Ree MJ 1993). Structured interviews for pilot selection: No incremental validity. International Journal of Aviation Psychology, 3, 25 38.
92. Wanous JP, Sullivan SE, Malinak J 1989). The role of judgment calls in meta-analysis. Journal of Applied Psychology, 74, 259 264.
93. Wiesner W, Cronshaw S 1988). A meta-analytic investigation of the impact of interview format and degree of structure on the validity of the employment interview. Journal of Occupational Psychology, 61, 275 290.
94. *Zaccaria MA, Dailey JT, Tupes EC, Stafford AR, Lawrence HG, Ailsworth KA 1956). Development of an interview procedure for USAF officer applicants (AFPTRC-TN-56-43, Project No. 7701). Lackland Air Force Base, TX : Air Research and Development Command.