Developments in the criterion-related validation of selection procedures: A critical review and recommendations for practice

Personnel Psychology

Volumn 61, Issue 4, 2008, Pages 871-925

  Van Iddekinge, Chad H ^a   Ployhart, Robert E ^b  

^a FLORIDA STATE UNIVERSITY   (United States)

^b UNIVERSITY OF SOUTH CAROLINA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 55349089583     PISSN: 00315826     EISSN: 17446570     Source Type: Journal    
DOI: 10.1111/j.1744-6570.2008.00133.x     Document Type: Review

References (190)

1. Abelson MA 1987). Examination of avoidable and unavoidable turnover. Journal of Applied Psychology, 72, 382 386.
2. Aguinis H, Boik RJ, Pierce CA 2001). A generalized solution for approximating the power to detect effects of categorical moderator variables using multiple regression. Organizational Research Methods, 4, 291 323.
3. Aguinis H, Peterson SA, Pierce CA 1999). Appraisal of the homogeneity of error variance assumption and alternatives to multiple regression for estimating moderating effects of categorical variables. Organizational Research Methods, 2, 315 329.
4. Aguinis H, Pierce CA 2006). Computation of effect size for moderating effects of categorical variables in multiple regression. Applied Psychological Measurement, 30, 440 442.
5. Aguinis H, Smith MA 2007). Understanding the impact of test validity and bias on selection errors and adverse impact in human resource selection. Personnel Psychology, 60, 165 199.
6. Aguinis H, Stone-Romero EF 1997). Methodological artifacts in moderated multiple regression and their effects on statistical power. Journal of Applied Psychology, 82, 192 206.
7. Allworth E, Hesketh B 1999). Construct-oriented biodata: Capturing change-related and contextually relevant future performance. International Journal of Selection and Assessment, 7, 97 111.
8. American Educational Research Association, American Psychological Association, National Council on Measurement in Education 1999). Standards for educational and psychological testing. Washington, DC : AERA.
9. Anderson N, Lievens F, van Dam K, Ryan AM 2004). Future perspectives on employee selection: Key directions for future research and practice. Applied Psychology: An International Review, 53, 487 501.
10. Arthur WJ, Bell ST, Villado AJ, Doverspike D 2006). The use of person-organization fit in employment decision making: An assessment of its criterion-related validity. Journal of Applied Psychology, 91, 786 801.
11. Arthur WJ, Villado AJ 2008). The importance of distinguishing between constructs and methods when comparing predictors in personnel selection research and practice. Journal of Applied Psychology, 93, 435 442.
12. Arvey RD, Strickland WJ, Drauden G, Martin C 1990). Motivational components of test taking. Personnel Psychology, 43, 695 716.
13. Barrett GV, Caldwell MS, Alexander RA 1985). The concept of dynamic criteria: A critical reanalysis. Personnel Psychology, 5, 41 56.
14. Barrett GV, Philips JS, Alexander RA 1981). Concurrent and predictive validity designs: A critical reanalysis. Journal of Applied Psychology, 66, 1 6.
15. Barrick MR, Stewart GL, Neubert MJ, Mount MK 1998). Relating member ability and personality to work-team processes and team effectiveness. Journal of Applied Psychology, 83, 377 391.
16. Barrick MR, Zimmerman RD 2005). Reducing voluntary, avoidable turnover through selection. Journal of Applied Psychology, 90, 159 166.
17. Bartlett CJ, Bobko P, Mosier SB, Hannan R 1978). Testing for fairness with a moderated multiple regression strategy: An alternative to differential prediction. Personnel Psychology, 31, 233 241.
18. Bartram D 2005). The great eight competencies: A criterion-centric approach to validation. Journal of Applied Psychology, 90, 1185 1203.
19. Bennett RJ, Robinson SL 2000). Development of a measure of workplace deviance. Journal of Applied Psychology, 85, 349 360.
20. Berry CM, Ones DS, Sackett PR 2007). Interpersonal deviance, organizational deviance, and their common correlates: A review and meta-analysis. Journal of Applied Psychology, 92, 410 424.
21. Binning JF, Barrett GV 1989). Validity of personnel decisions: A conceptual analysis of the inferential and evidential bases. Journal of Applied Psychology, 74, 478 494.
22. Birkeland SA, Kisamore JL, Brannick MT, Smith MA 2006). A meta-analytic investigation of job applicant faking on personality measures. International Journal of Selection and Assessment, 14, 317 335.
23. Bliese PD 1998). Group size, ICC values, and group-level correlations: A simulation. Organizational Research Methods, 1, 355 373.
24. Bobko P, Roth PL, Potosky D 1999). Derivation and implications of a meta-analysis matrix incorporating cognitive ability, alternative predictors, and job performance. Personnel Psychology, 52, 561 589.
25. Borman WC, Motowidlo SJ 1993). Expanding the criterion domain to include elements of contextual performance. In Schmitt N, Borman WC (Eds. Personnel selection in organizations (pp. 71 98). San Francisco : Jossey-Bass.
26. Borman WC, Motowidlo SJ 1997). Task performance and contextual performance: The meaning for personnel selection research. Human Performance, 10, 99 109.
27. Brief AP, Motowidlo SJ 1986). Prosocial organizational behaviors. Academy of Management Review, 11, 710 725.
28. Budescu DV 1993). Dominance analysis: A new approach to the problem of relative importance of predictors in multiple regression. Psychological Bulletin, 114, 542 551.
29. Budescu DV, Azen R 2004). Beyond global measures of relative importance: Some insights from dominance analysis. Organizational Research Methods, 7, 341 350.
30. Burket GR 1964). A study of reduced rank models for multiple prediction. Psychometricka Monograph Supplement, 12.
31. Callender JC, Osburn HG 1980). Development and test of a new model for validity generalization. Journal of Applied Psychology, 65, 543 558.
32. Cattin P 1980). Estimating the predictive power of a regression model. Journal of Applied Psychology, 65, 407 414.
33. Cellar DF, Miller ML, Doverspike DD, Klawsky JD 1996). Comparison of factor structures and criterion-related validity coefficients for two measures of personality based of the five factor model. Journal of Applied Psychology, 81, 694 704.
34. Chan D, Schmitt N 2002). Situational judgment and job performance. Human Performance, 15, 233 254.
35. Cleary TA 1968). Test bias: Prediction of grades of negro and white students in integrated colleges. Journal of Educational Measurement, 5, 115 124.
36. Coleman VI, Borman WC 2000). Investigating the underlying structure of the citizenship performance domain. Human Resource Management Review, 10, 25 44.
37. Conway JM 1999). Distinguishing contextual performance from task performance for managerial jobs. Journal of Applied Psychology, 84, 3 13.
38. Cronbach LJ 1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297 334.
39. Cronbach LJ, Gleser GC, Nanda H, Rajaratnam N 1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York : Wiley.
40. Dalal RS 2005). Meta-analysis of the relationship between organizational citizenship behavior and counterproductive work behavior. Journal of Applied Psychology, 90, 1241 1255.
41. De Corte W 1999). Weighting job performance predictors to both maximize the quality of the selected workforce and control the level of adverse impact. Journal of Applied Psychology, 84, 695 702.
42. De Corte W, Lievens F 2003). A practical procedure to estimate the quality and the adverse impact of single-stage selection decisions. International Journal of Selection and Assessment, 11, 89 97.
43. De Corte W, Lievens F, Sackett PR 2006). Predicting adverse impact and mean criterion performance in multistage selection. Journal of Applied Psychology, 91, 523 537.
44. De Corte W, Lievens F, Sackett PR 2007). Combining predictors to achieve optimal trade-offs between selection quality and adverse impact. Journal of Applied Psychology, 92, 1380 1393.
45. Deadrick DL, Bennett N, Russell CJ 1997). Using hierchical linear modeling to examine dynamic performance criteria over time. Journal of Management, 23, 745 757.
46. DeShon RP 2002). Generalizability theory. In Drasgow F, Schmitt N (Eds. Measuring and analyzing behavior in organizations: Advances in measurement and data analysis (pp. 189 220). San Francisco : Jossey-Bass.
47. DeShon RP 2003). A generalizability theory perspective on measurement error corrections in validity generalization. In Murphy KR (Ed. Validity generalization: A critical review (pp. 365 402). Mahwah, NJ : Erlbaum.
48. DuBois CLZ, Sackett PR, Zedeck S, Fogli L 1993). Further exploration of typical and maximum performance criteria: Definitional issues, prediction, and white-black differences. Journal of Applied Psychology, 78, 205 211.
49. Dudley NM, Orvis KA, Lebiecki JA, Cortina JM 2006). A meta-analytic investigation of conscientiousness in the prediction of job performance: Examining the intercorrelations and the incremental validity of narrow traits. Journal of Applied Psychology, 91, 40 57.
50. Dunbar SB, Linn RL 1991). Range restriction adjustments in the prediction of military job performance. In Wigdor AK, Green BF Jr. Eds. Performance assessment for the workplace (Vol. 2, pp. 127 157). Washington, DC : National Academy Press.
51. Dunbar SB, Novick MR 1988). On predicting success in training for men and women: Examples from Marine Corps clerical specialties. Journal of Applied Psychology, 75, 545 550.
52. Dunnette MD 1963). A note on the criterion. Journal of Applied Psychology, 47, 251 254.
53. Dunnette MD, McCartney J, Carlson HC, Kirchner WK 1962). A study of faking behavior on a forced-choice self-description checklist. Personnel Psychology, 15, 13 24.
54. Ellingson JE, Sackett PR, Connelly BS 2007). Personality assessment across selection and development contexts: Insights into response distortion. Journal of Applied Psychology, 92, 386 395.
55. Equal Employment Opportunity Commission C. S. C, Department of Labor, and Department of Justice 1978). Uniform guidelines on employee selection procedures, Federal Register, 43 (166 38295 38309.
56. Farrell JN, McDaniel MA 2001). The stability of validity coefficients over time: Ackerman's (1988) model and the General Aptitude Test Battery. Journal of Applied Psychology, 86, 60 79.
57. Ferris GR, Witt LA, Hochwarter WA 2001). Interaction of social skill and general mental ability on job performance and salary. Journal of Applied Psychology, 86, 1075 1082.
58. Ghiselli EE 1956). Dimensional problems of criteria. Journal of Applied Psychology, 40, 1 4.
59. Gruys ML, Sackett PR 2003). Investigating the dimensionality of counterproductive work behavior. International Journal of Selection and Assessment, 11, 30 42.
60. Guion RM 1961). Criterion measurement and personnel judgments. Personnel Psychology, 14, 141 149.
61. Guion RM 1991). Personnel assessment, selection, and placement. In Dunnette MD, Hough LM (Eds. Handbook of industrial and organizational psychology (2nd ed., Vol. 2, pp. 327 397). Palo Alto, CA : Consulting Psychologists Press.
62. Guion RM 1998). Assessment, measurement, and prediction for personnel decisions. Mahwah, NJ : Erlbaum.
63. Guion RM, Cranny CJ 1982). A note on concurrent versus predictive validity designs: A critical reanalysis. Journal of Applied Psychology, 67, 239 244.
64. Harold CM, McFarland LA, Weekley JA 2006). The validity of verifiable and non-verifiable biodata items: An examination across applicants and incumbents. International Journal of Selection and Assessment, 14, 336 346.
65. Hattrup K, O'Connell MS, Wingate PH 1998). Prediction of multidimensional criteria: Distinguishing task and contextual performance. Human Performance, 11, 305 319.
66. Hattrup K, Rock J, Scalia C 1997). The effects of varying conceptualizations of job performance on adverse impact, minority hiring, and predicted performance. Journal of Applied Psychology, 82, 656 664.
67. Hausknecht JP, Halpert JA, Di Paolo NT, Moriarty Gerrard MO 2007). Retesting in selection: A meta-analysis of coaching and practice effects for tests of cognitive ability. Journal of Applied Psychology, 92, 373 385.
68. Hausknecht JP, Trevor CO, Farr JL 2002). Retaking ability tests in a selection setting: Implications for practice effects, training performance, and turnover. Journal of Applied Psychology, 87, 243 254.
69. Hoffman BJ, Blair CA, Meriac JP, Woehr DJ 2007). Expanding the criterion domain? A quantitative review of the OCB literature. Journal of Applied Psychology, 92, 555 566.
70. Hogan J, Barrett P, Hogan R 2007). Personality measurement, faking, and employment selection. Journal of Applied Psychology, 92, 1270 1285.
71. Hogan J, Holland B 2003). Using theory to evaluate personality and job-performance relations: A socioanalytic perspective. Journal of Applied Psychology, 88, 100 112.
72. Hough LM 1992). The "Big Five" personality variables-construct confusion: Description versus prediction. Human Performance, 5, 139 155.
73. Hough LM 1998). Personality at work: Issues and evidence. In Hakel M (Ed. Beyond multiple choice: Evaluating alternatives to traditional testing for selection (pp. 131 166). Mahwah, NJ : Erlbaum.
74. Hough LM 2001). I/Owes its advances to personality. In Roberts B, Hogan RT (Eds. Applied personality psychology: The intersection between personality and I/O psychology (pp. 19 44). Washington, DC : American Psychological Association.
75. Houston WM, Novick MR 1987). Race-based differential prediction in Air Force technical training programs. Journal of Educational Measurements, 24, 309 320.
76. Huffcutt AI, Conway JM, Roth PL, Klehe U-C 2004). The impact of job complexity and study design on situational and behavior description interview validity. International Journal of Selection and Assessment, 12, 262 273.
77. Huffcutt AI, Conway JM, Roth PL, Stone NJ 2001). Identification and meta-analytic assessment of psychological constructs measured in employment interviews. Journal of Applied Psychology, 86, 897 913.
78. Humphreys LG 1960). Investigations of the simplex. Psychometricka, 25, 313 323.
79. Hunter JE, Schmidt FL, Le H 2006). Implications for direct and indirect range restriction for meta-analysis methods and findings. Journal of Applied Psychology, 91, 594 612.
80. Hurtz GM, Donovan JJ 2000). Personality and job performance: The Big Five revisited. Journal of Applied Psychology, 85, 869 879.
81. Huselid MA 1995). The impact of human resource management practices on turnover, productivity, and corporate financial performance. Academy of Management Journal, 38, 635 672.
82. Ilgen DR, Pulakos ED 1999). Employee performance in today's organizations. In Ilgen DR, Pulakos ED (Eds. The changing nature of work performance: Implications for staffing, motivation, and development (pp. 1 20). San Francisco : Jossey-Bass.
83. Jackson DN, Harris WG, Ashton MC, McCarthy JM, Tremblay PF 2000). How useful are work samples in validation studies. International Journal of Selection and Assessment, 8, 29 33.
84. James LR 1980). The unmeasured variables problem in path analysis. Journal of Applied Psychology, 65, 415 421.
85. James LR, Demaree RG, Wolf G 1984). Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology, 69, 85 98.
86. Johnson JW 2000). A heuristic method for estimating the relative weights of predictor variables in multiple regression. Multivariate Behavioral Research, 35, 1 19.
87. Johnson JW 2001). The relative importance of task and contextual performance dimensions to supervisor judgments of overall performance. Journal of Applied Psychology, 86, 984 996.
88. Johnson JW 2004). Factors affecting relative weights: The influence of sampling and measurement error. Organizational Research Methods, 7, 283 299.
89. Johnson JW 2007, April). Distinguishing adaptive performance from task and citizenship performance. In Oswald FL, Oberlander EM (Chairs Adaptive skills and adaptive performance: Today's organizational reality. Symposium conducted at the 22nd Annual Conference of the Society for Industrial and Organizational Psychology, New York.
90. Johnson JW, Carter GW, Davison HK, Oliver DH 2001). A synthetic validity approach to testing differential prediction hypotheses. Journal of Applied Psychology, 86, 774 780.
91. Johnson JW, LeBreton JM 2004). History and use of relative importance indices in organizational research. Organizational Research Methods, 7, 238 257.
92. Keil CT, Cortina JM 2001). Degradation of validity over time: A test and extension of Ackerman's model. Psychological Bulletin, 127, 673 697.
93. Kirk AK, Brown DF 2003). Latent constructs of proximal and distal motivation predicting performance under maximum test conditions. Journal of Applied Psychology, 88, 40 49.
94. Klehe U-C, Anderson N 2007). Working hard and working smart: Motivation and ability during typical and maximum performance. Journal of Applied Psychology, 92, 978 992.
95. Klehe U-C, Anderson N, Viswesvaran C 2007). More than peaks and valleys: Introduction to the special issue on typical and maximum performance. Human Performance, 20, 173 178.
96. Klehe U-C, Latham GP 2006). What would you do - really or ideally? Constructs underlying the behavioral description interview and situational interview for predicting typical versus maximum performance. Human Performance, 19, 357 381.
97. Ladd RT, Atchley EK, Gniatczyk LA, Baumann LB 2002, April). An evaluation of the construct validity of an assessment center using multiple-regression importance analysis. Paper presented at the 17th Annual Conference of the Society for Industrial and Organizational Psychology, Toronto.
98. Landy FJ 1986). Stamp collecting versus science: Validation as hypothesis testing. American Psychologist, 41, 1183 1192.
99. Larson SC 1931). The shrinkage of the coefficient of multiple correlation. Journal of Educational Psychology, 22, 45 55.
100. Le H, Schmidt FL 2006). Correcting for indirect range restriction in meta-analysis: Testing a new meta-analytic procedure. Psychological Methods, 4, 416 438.
101. LeBreton JM, Burgess JRD, Kaiser RB, Atchley EK, James LR 2003). The restriction of variance hypothesis and interrater reliability and agreement: Are ratings from multiple sources really dissimilar? Organizational Research Methods, 6, 80 128.
102. LeBreton JM, Hargis MB, Griepentrog B, Oswald FL, Ployhart RE 2007). A multidimensional approach for evaluating variables in organizational research and practice. Personnel Psychology, 60, 475 498.
103. LeBreton JM, Ployhart RE, Ladd RT 2004). A Monte Carlo comparison of relative importance methodologies. Organizational Research Methods, 7, 258 282.
104. Lee K, Allen NJ 2002). Organizational citizenship behavior and workplace deviance: The role of affect and cognitions. Journal of Applied Psychology, 87, 131 142.
105. LePine JA, Van Dyne L 2001). Voice and cooperative behavior as contrasting forms of contextual performance: Evidence of differential relationships with Big Five personality characteristics and cognitive ability. Journal of Applied Psychology, 86, 326 336.
106. Lievens F, Buyse T, Sackett PR 2005). Retest effects in operational selection settings: Developments and test of a framework. Personnel Psychology, 58, 981 1007.
107. Lievens F, Reeve CL, Heggestad ED 2007). An examination of psychometric bias due to retesting on cognitive ability tests in selection settings. Journal of Applied Psychology, 92, 1672 1682.
108. Linn RL, Harnisch DL, Dunbar SB 1981). Corrections for range restriction: An empirical investigation of conditions resulting in conservative corrections. Journal of Applied Psychology, 66, 655 663.
109. Marcus B, Goffin RD, Johnston NG, Rothstein MG 2007). Personality and cognitive ability as predictors of typical and maximum managerial performance. Human Performance, 20, 275 285.
110. McDaniel MA, Morgeson FP, Finnegan EB, Campion MA, Braverman EP 2001). Predicting job performance from common sense. Journal of Applied Psychology, 86, 730 740.
111. McGraw KO, Wong SP 1996). Forming inferences about some intraclass correlations coefficients. Psychological Methods, 1, 30 46.
112. McKay PF, McDaniel MA 2006). A reexamination of Black-White mean differences in work performance: More data, more moderators. Journal of Applied Psychology, 91, 538 554.
113. McManus MA, Kelly ML 1999). Personality measures and biodata: Evidence regarding their incremental predictive value in the life insurance industry. Personnel Psychology, 52, 137 148.
114. McPhail SM 2007). Alternative validation strategies: Developing new and leveraging existing validity evidence. San Francisco : Wiley.
115. Messick SJ 1998). Alternative models of assessment, uniform standards of validity. In Hakel MD (Ed. Beyond multiple choice: Evaluating alternatives to traditional testing for selection (pp. 59 74). Mahwah, NJ : Erlbaum.
116. Morgeson FP, Reider MH, Campion MA 2005). Selecting individuals in team settings: The importance of social skills, personality characteristics, and teamwork knowledge. Personnel Psychology, 58, 583 611.
117. Motowidlo SJ 2000). Some basic issues related to contextual performance and organizational citizenship behavior in human resource management. Human Resource Management Review, 10, 115 126.
118. Mount MK, Witt LA, Barrick MR 2000). Incremental validity of empirically keyed biodata scales over GMA and the five-factor personality constructs. Personnel Psychology, 53, 299 323.
119. Murphy KR 1989). Is the relationship between cognitive ability and job performance stable over time? Human Performance, 2, 183 200.
120. Murphy KR, Cleveland JN, Skattebo AL, Kinney TB 2004). Raters who pursue different goals give different ratings. Journal of Applied Psychology, 89, 158 164.
121. Murphy KR, DeShon RP 2000). Interrater correlations do not estimate the reliability of job performance ratings. Personnel Psychology, 53, 873 900.
122. Murphy KR, Myors B 2004). Statistical power analysis: A simple and general model for traditional and modern hypothesis tests (2nd ed.). Mahwah, NJ : Erlbaum.
123. Murphy KR, Shiarella AH 1997). Implications of the multidimensional nature of job performance for the validity of selection tests: Multivariate frameworks for studying test validity. Personnel Psychology, 50, 823 854.
124. Nagle BF 1953). Criterion development. Personnel Psychology, 6, 271 289.
125. Newman DA, Jacobs RR, Bartram D 2007). Choosing the best method for local validity estimation: Relative accuracy of meta-analysis versus a local study versus Bayes-analysis. Journal of Applied Psychology, 92, 1394 1413.
126. Ones DS, Viswesvaran C 2003). Job-specific applicant pools and national norms for personality scales: Implications for range-restriction corrections in validation research. Journal of Applied Psychology, 88, 570 577.
127. Organ DW 1988). Organizational citizenship behavior: The good soldier syndrome. Lexington, MA : Lexington.
128. Organ DW 1997). Organizational citizenship behavior: It's construct clean-up time. Human Performance, 10, 85 97.
129. Oswald FL, Saad S, Sackett PR 2000). The homogeneity assumption in differential prediction analysis: Does it really matter. Journal of Applied Psychology, 85, 536 541.
130. Ployhart RE 2006). Staffing in the 21st century: New challenges and strategic opportunities. Journal of Management, 32, 868 897.
131. Ployhart RE, Hakel MD 1998). The substantive nature of performance variability: Predicting interindividual differences in intraindividual performance. Personnel Psychology, 51, 859 901.
132. Ployhart RE, Lim B-C, Chan K-Y 2001). Exploring relations between typical and maximum performance ratings and the five-factor model of personality. Personnel Psychology, 54, 809 843.
133. Ployhart RE, Schneider B, Schmitt N 2006). Staffing organizations: Contemporary practice and theory (3rd ed.). Mahwah, NJ : Erlbaum.
134. Pulakos ED, Arad S, Donovan MA, Plamondon KE 2000). Adaptability in the workplace: Development of a taxonomy of adaptive performance. Journal of Applied Psychology, 85, 612 624.
135. Pulakos ED, Schmitt N, Dorsey DW, Arad S, Hedge JW, Borman WC 2002). Predicting adaptive performance: Further tests of a model of adaptability. Human Performance, 15, 299 323.
136. Raju NS, Bilgic R, Edwards JE, Fleer PF 1997). Methodology review: Estimation of population validity and cross-validity, and the use of equal weights in prediction. Applied Psychological Measurement, 21, 291 305.
137. Raju NS, Bilgic R, Edwards JE, Fleer PF 1999). Accuracy of population validity and cross-validity estimation: An empirical comparison of formula-based, traditional empirical, and equal weights procedures. Applied Psychological Measurement, 23, 99 115.
138. Raymond MR, Neustel S, Anderson D 2007). Retest effects and parallel forms in certification and licensure testing. Personnel Psychology, 60, 367 396.
139. Robie C, Zickar MJ, Schmit MJ 2001). Measurement equivalence between applicant and incumbent groups: An IRT analysis of personality. Human Performance, 14, 187 207.
140. Robinson SL, Bennett RJ 1995). A typology of deviant workplace behaviors: A multidimensional scaling study. Academy of Management Journal, 38, 555 572.
141. Roth PL, Bobko P, McFarland LA 2005). A meta-analysis of work sample test validity: Updating and integrating some classic literature. Personnel Psychology, 58, 1009 1037.
142. Roth PL, Huffcutt AI, Bobko P 2003). Ethnic group differences in measures of job performance: A new meta-analysis. Journal of Applied Psychology, 88, 694 706.
143. Rotundo M, Sackett PR 1999). Effect of rater race on conclusions regarding differential prediction in cognitive ability tests. Journal of Applied Psychology, 84, 815 822.
144. Rotundo M, Sackett PR 2002). The relative importance of task, citizenship, and counterproductive performance to global ratings of job performance: A policy-capturing approach. Journal of Applied Psychology, 87, 66 80.
145. Saad S, Sackett PR 2002). Investigating differential prediction by gender in employment-related personality measures. Journal of Applied Psychology, 87, 667 674.
146. Sackett PR, Berry CM, Wiemann SA, Laczo RM 2006). Citizenship and counterproductive behavior: Clarifying relations between the two domains. Human Performance, 19, 441 464.
147. Sackett PR, Laczo RM, Arvey RD 2002). The effects of range restriction on estimates of criterion interrater reliability: Implications for validation research. Personnel Psychology, 55, 807 825.
148. Sackett PR, Laczo RM, Lippe ZP 2003). Differential prediction and the use of multiple predictors: The omitted variables problem. Journal of Applied Psychology, 88, 1046 1056.
149. Sackett PR, Lievens F, Berry CM, Landers RN 2007). A cautionary note on the effects of range restriction on predictor intercorrelations. Journal of Applied Psychology, 92, 538 544.
150. Sackett PR, Ostgaard DJ 1994). Job-specific applicant pools and national norms for cognitive ability tests: Implications for range restriction corrections in validation research. Journal of Applied Psychology, 79, 680 684.
151. Sackett PR, Yang H 2000). Correction for range restriction: An expanded typology. Journal of Applied Psychology, 85, 112 118.
152. Sackett PR, Zedeck S, Fogli L 1988). Relations between measures of typical and maximum job performance. Journal of Applied Psychology, 73, 482 486.
153. Salgado JF, Ones DS, Viswesvaran C 2001). Predictors used for personnel selection: An overview of constructs, methods and techniques. In Anderson N, Ones DS, Sinangil HK, Viswesvaran C (Eds. Handbook of industrial, work, and organizational psychology (Vol. 1, pp. 165 199). Thousand Oaks, CA : Sage.
154. Scherbaum CA 2005). Synthetic validity: Past, present, and future. Personnel Psychology, 58, 481 515.
155. Schmidt FL 1971). The relative efficiency of regression and simple unit predictor weights in applied differential psychology. Educational and Psychological Measurement, 31, 699 714.
156. Schmidt FL, Hunter JE 1996). Measurement error in psychological research: Lessons from 26 research scenarios. Psychological Methods, 1, 199 223.
157. Schmidt FL, Hunter JE 1998). The validity and utility of selection methods in personnel selection: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262 274.
158. Schmidt FL, Hunter JE, Urry VW 1976). Statistical power in criterion-related validation studies. Journal of Applied Psychology, 61, 473 485.
159. Schmidt FL, Kaplan LB 1971). Composite versus multiple criteria: A review and resolution of the controversy. Personnel Psychology, 24, 419 434.
160. Schmidt FL, Le H, Ilies R 2003). Beyond alpha: An empirical examination of the effects of different sources of measurement error on reliability estimates for measures of individual-differences constructs. Psychological Methods, 8, 206 224.
161. Schmidt FL, Oh I-S, Le H 2006). Increasing the accuracy of corrections for range restriction: Implications for selection procedure validities and other research results. Personnel Psychology, 59, 281 305.
162. Schmidt FL, Pearlman K, Hunter JE 1981). The validity and fairness of employment and educational tests for Hispanic Americans: A review and analysis. Personnel Psychology, 33, 705 724.
163. Schmidt FL, Viswesvaran C, Ones DS 2000). Reliability is not validity and validity is not reliability. Personnel Psychology, 53, 901 912.
164. Schmit MJ, Ryan AM 1993). The Big Five in personnel selection: Factor structure in applicant and nonapplicant populations. Journal of Applied Psychology, 78, 966 974.
165. Schmitt N 1996). Uses and abuses of coefficient alpha. Psychological Assessment, 8, 350 353.
166. Schmitt N 2007). The value of personnel selection: Reflections on some remarkable claims. Academy of Management Perspectives, 21, 19 23.
167. Schmitt N, Chan D 2006). Situational judgment tests: Method or construct. In Weekley JA, Ployhart RE (Eds. Situational judgment tests: Theory, measurement, and application (pp. 135 154). Mahwah, NJ : Erlbaum.
168. Schmitt N, Landy FJ 1993). The concept of validity. In Schmitt N, Borman W (Eds. Personnel selection in organizations (pp. 275 309). San Francisco : Jossey-Bass.
169. Schmitt N, Ployhart RE 1999). Estimates of cross-validity for stepwise regression and with predictor selection. Journal of Applied Psychology, 84, 50 57.
170. Schmitt N, Rogers W, Chan D, Sheppard L, Jennings D 1997). Adverse impact and predictor efficiency of various predictor combinations. Journal of Applied Psychology, 82, 719 730.
171. Sharf JC, Jones DP 2000). Employment risk management. In Kehoe JF (Ed. Managing selection in changing organizations (pp. 271 318). San Francisco : Jossey-Bass.
172. Smith CA, Organ DW, Near JP 1983). Organizational citizenship behavior: Its nature and antecedents. Journal of Applied Psychology, 68, 653 663.
173. Smith DB, Ellingson JE 2002). Substance versus style: A new look at social desirability in motivating contexts. Journal of Applied Psychology, 87, 211 219.
174. Smith DB, Hanges PJ, Dickson MW 2001). Personnel selection and the five-factor model: Reexamining the effects of applicant's frame of reference. Journal of Applied Psychology, 86, 304 315.
175. Society for Industrial and Organizational Psychology, I 2003). Principles for the validation and use of personnel selection procedures (4th ed.). Bowling Green, OH : Author.
176. Stewart GL 1999). Trait bandwidth and stages of job performance. Journal of Applied Psychology, 84, 959 968.
177. Sturman MC, Cheramie RA, Cashen LH 2005). The impact of job complexity and performance measurement on the temporal consistency, stability, and test-retest reliability of employee job performance ratings. Journal of Applied Psychology, 90, 269 283.
178. Thoresen CJ, Bradley JC, Bliese PD, Thoresen JD 2004). The big five personality traits and individual job performance growth trajectories in maintenance and transitional job stages. Journal of Applied Psychology, 89, 835 853.
179. Thorndike RL 1949). Personnel selection. New York : Wiley.
180. Van Scotter JR, Motowidlo SJ 1996). Interpersonal facilitation and job dedication as separate facets of contextual performance. Journal of Applied Psychology, 81, 525 531.
181. Van Scotter JR, Motowidlo SJ, Cross TC 2000). Effects of task performance and contextual performance on systemic rewards. Journal of Applied Psychology, 85, 526 535.
182. Viswesvaran C, Ones DS, Schmidt FL 1996). Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology, 81, 557 574.
183. Viswesvaran C, Schmidt FL, Ones DS 2002). The moderating influence of job performance dimensions on convergence of supervisory and peer ratings of job performance: Unconfounding construct-level convergence and rating difficulty. Journal of Applied Psychology, 87, 345 354.
184. Viswesvaran C, Schmidt FL, Ones DS 2005). Is there a general factor in ratings of job performance? A meta-analysis framework for disentangling
185. Wallace SR 1965). Criteria for what? American Psychologist, 20, 411 417.
186. Weekley JA, Ployhart RE, Harold CM 2004). Personality and situational judgment tests across applicant and incumbent settings: An examination of validity, measurement, and subgroup differences. Human Performance, 17, 433 461.
187. Wonderlic Personnel Test, Inc 1998). Comprehensive personality profile. Libertyville, IL : Author.
188. Wong KFE, Kwong JYY 2007). Effects of rater goals and rating patterns: Evidence from an experimental field study. Journal of Applied Psychology, 92, 577 585.
189. Wright PM, Boswell WR 2002). Desegregating HRM: A review and synthesis of micro and macro human resources management research. Journal of Management, 28, 247 276.
190. Yang H, Sackett PR, Nho Y 2004). Developing a procedure to correct for range restriction that involves both institutional selection and applicants' rejection of job offers. Organizational Research Methods, 7, 442 455.