The diversity-validity dilemma: Strategies for reducing racioethnic and sex subgroup differences and adverse impact in selection

Personnel Psychology

Volumn 61, Issue 1, 2008, Pages 153-172

  Ployhart, Robert E ^a,c   Holtz, Brian C ^b  

^a UNIVERSITY OF SOUTH CAROLINA   (United States)

^b UNIVERSITY OF CALGARY   (Canada)

^c UNIVERSITY OF SOUTH CAROLINA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 38949132521     PISSN: 00315826     EISSN: 17446570     Source Type: Journal    
DOI: 10.1111/j.1744-6570.2008.00109.x     Document Type: Article

References (55)

1. Aguinis H 2004). Test score banding in human resource selection: Legal, technical, and societal issues. Westport, CT : Quorum.
2. Arthur W, Edwards BD, Barrett GV 2002). Multiple-choice and constructed response tests of ability: Race-based subgroup performance differences on alternative paper-and-pencil test formats. Personnel Psychology, 55, 985 1008.
3. Berry C, Gruys M, Sackett PR 2006). Educational attainment as a proxy for cognitive ability in selection: Effects on levels of cognitive ability and adverse impact. Journal of Applied Psychology, 91, 696 705.
4. Bobko P, Roth PL, Buster MA 2005). Work sample selection tests and expected reduction in adverse impact: A cautionary note. International Journal of Selection and Assessment, 1 10.
5. Bobko P, Roth PL, Potosky D 1999). Derivation and implications of a meta-analysis matrix incorporating cognitive ability, alternative predictors, and job performance. Personnel Psychology, 52, 561 589.
6. Campion MA, Outtz JL, Zedeck S, Schmidt FL, Kehoe JF, Murphy KR, et al (2001). The controversy over score banding in personnel selection: Answers to 10 key questions. Personnel Psychology, 54, 149 185.
7. Cullen MJ, Hardison CM, Sackett PR 2004). Using SAT-grade and ability-job performance relationships to test predictions derived from stereotype threat theory. Journal of Applied Psychology 89, 220 230.
8. DeCorte W 1999). Weighting job performance predictors to both maximize the quality of the selected workforce and control the level of adverse impact. Journal of Applied Psychology, 84, 695 702.
9. DeCorte W, Lievens F 2003). A practical procedure to estimate the quality and adverse impact of single-stage selection decisions. International Journal of Selection and Assessment, 11, 89 97.
10. DeShon RP, Smith MR, Chan D, Schmitt N 1998). Can racial differences in cognitive test performance be reduced by presenting problems in a social context Journal of Applied Psychology, 83, 438 451.
11. Edwards BD, Arthur W 2004, April). Race-based subgroup differences on a constructed response paper-and-pencil test. Poster presented at the 19th Annual Conference of the Society for Industrial and Organizational Psychology, Chicago, IL.
12. Farr JL Ed 2003). Stereotype threat effects in employment settings [Special Issue]. Human Performance, 16 (3).
13. Goldstein HW, Yusko KP, Braverman EP, Smith DB, Chung B 1998). The role of cognitive ability in the subgroup differences and incremental validity of assessment center exercises. Personnel Psychology, 51, 357 374.
14. Goldstein HW, Yusko KP, Nicolopoulos V 2001). Exploring Black-White subgroup differences of managerial competencies. Personnel Psychology, 54, 783 807.
15. Hattrup K, Rock J, Scalia C 1997). The effects of varying conceptualizations of job performance on adverse impact, minority hiring, and predicted performance. Journal of Applied Psychology, 82, 656 664.
16. Hausknecht JP, Day DV, Thomas SC 2004). Applicant reactions to selection procedures: An updated model and meta-analysis. Personnel Psychology, 57, 639 683.
17. Hogan J 1991). Physical abilities. In Dunnette MD, Hough LM (Eds Handbook of industrial and organizational psychology Vol. 2, pp. 753 831). Palo Alto, CA : Consulting Psychologists Press.
18. Hough LM 1984). Development and evaluation of the "accomplishment record" method of selecting and promoting professionals. Journal of Applied Psychology, 69, 135 146.
19. Hough LM, Furnham A 2003). Use of personality variables in work settings. In Borman WC, Ilgen DR Eds Handbook of psychology: Industrial and organizational psychology (Vol. 12, pp. 131 169). New York : Wiley.
20. Hough LM, Oswald FL, Ployhart RE 2001). Determinants, detection, and amelioration of adverse impact in personnel selection procedures: Issues, evidence, and lessons learned. International Journal of Selection and Assessment, 9, 152 194.
21. Huffcutt AI, Conway JM, Roth PL, Stone NJ 2001). Identification and meta-analytic assessment of psychological constructs measured in employment interviews. Journal of Applied Psychology, 86, 897 913.
22. Huffcutt AI, Roth PL 1998). Racial group differences in employment interview evaluations. Journal of Applied Psychology, 83, 179 189.
23. Hunter JE, Hunter R 1984). Validity and utility of alternative predictors. Psychological Bulletin, 96, 72 98.
24. Knapp DJ, Sager CE, Tremble TR 2005). Development of experimental army enlisted personnel selection and classification tests and job performance. Technical Report 1168, Army Research Institute, Arlington, VA.
25. Kravitz DA 2008). The diversity-validity dilemma: Beyond selection - The role of affirmative action. Personnel Psychology, 61, 173 193.
26. LeBreton JM, Griepentrog B, Hargis MB, Oswald FL, Ployhart RE 2007). A multidimensional approach to evaluating variables in organizational research. Personnel Psychology, 60, 475 498.
27. McDaniel MA, Morgeson FP, Finnegan EB, Campion MA, Braverman EP 2001). Use of situational judgment tests to predict job performance: A clarification of the literature. Journal of Applied Psychology, 86, 730 740.
28. Messick S 1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741 749.
29. Murphy KR, Osten K, Myors B 1995). Modeling the effects of banding in personnel selection. Personnel Psychology, 48, 61 84.
30. Murphy KR, Shiarella AH 1997). Implications of the multidimensional nature of job performance for the validity of selection tests: Multivariate frameworks for studying test validity. Personnel Psychology, 50, 823 854.
31. Nguyen NT, McDaniel MA, Whetzel D 2005, April). Subgroup differences in situational judgment test performance: A meta-analysis. Paper presented at the 20th annual conference of the Society for Industrial and Organizational Psychology, Los Angeles, CA.
32. Pyburn KM, Jr., Ployhart RE, Kravitz DA 2008). The diversity-validity dilemma: Overview and legal context. Personnel Psychology, 61, 143 151.
33. Reckase MD 1996). Test construction in the 1990s: Recent approaches every psychologist should know. Psychological Assessment, 8, 354 359.
34. Roth PL, Bevier CA, Bobko P, Switzer FS, III., Tyler P 2001). Ethnic group differences in cognitive ability in employment and educational settings: A meta-analysis. Personnel Psychology, 54, 297 330.
35. Roth PL, Bobko P 2000). College grade point average as a personnel selection devise: Ethnic group differences and potential adverse impact. Journal of Applied Psychology, 85, 399 406.
36. Roth PL, Bobko P, McFarland LA 2005). A meta-analysis of work sample test validity. Personnel Psychology, 58, 1009 1037.
37. Roth PL, Huffcutt AI, Bobko P 2003). Ethnic group differences in measures of job performance: A new meta-analysis. Journal of Applied Psychology 88, 694 706.
38. Ryan AM 2001). Explaining the Black/White test score gap: The role of test perceptions. Human Performance, 14, 45 75.
39. Ryan AM, Ployhart RE, Friedel L 1998). Using personality tests to reduce adverse impact: A cautionary note. Journal of Applied Psychology, 83, 298 307.
40. Ryan AM, Sacco JM, McFarland LA, Kriska SD 2000). Applicant self-selection: Correlates of withdrawal from a multiple hurdle process. Journal of Applied Psychology, 85, 163 179.
41. Sacco JM, Scheu CR, Ryan AM, Schmitt N, Schmidt DB, Rogg KL 2000). Reading level and verbal test scores as predictors of subgroup differences and validities of situational judgment tests. Unpublished manuscript.
42. Sackett PR 2003). Stereotype threat in applied selection settings: A commentary. Human Performance, 16, 295 309.
43. Sackett PR, Ellingson JE 1997). The effects of forming multi-predictor composites on group differences and adverse impact. Personnel Psychology, 50, 707 721.
44. Sackett PR, Hardison CM, Cullen MJ 2004). On interpreting stereotype threat as accounting for African American-White differences on cognitive tests. American Psychologist, 59, 7 13.
45. Sackett PR, Roth L 1991). A Monte Carlo examination of banding and rank order methods of test score use in personnel selection. Human Performance, 4, 279 295.
46. Sackett PR, Roth L 1996). Multi-stage selection strategies: A Monte Carlo investigation of effects on performance and minority hiring. Personnel Psychology, 49, 549 572.
47. Sackett PR, Schmitt N, Ellingson JE, Kabin MB 2001). High-stakes testing in employment, credentialing, and higher education: Prospects in a post-affirmative action world. American Psychologist, 56, 302 318.
48. Salgado JF, Anderson N, Moscoso S, Bertua C, De Fruyt F 2003). International validity generalization of GMA and cognitive abilities: A European community meta-analysis. Personnel Psychology, 56, 573 605.
49. Schmidt FL, Hunter JE 1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262 274.
50. Schmitt N, Clause CS, Pulakos ED 1996). Subgroup differences associated with different measures of some common job-relevant constructs. International review of industrial and organizational psychology (Vol. 11, pp. 115 139). New York: Wiley.
51. Sin HP, Farr JL, Murphy KR, Hausknecht JP 2004). An investigation of Black-White differences in self-selection and performance in repeated testing. Paper presented at the 64th annual meeting of the Academy of Management. New Orleans, LA.
52. Steele CM, Spencer SJ, Aronson J 2002). Contending with group image: The psychology of stereotype and social identity threat. In Zanna MP (Ed Advances in experimental social psychology (Vol. 34, pp. 379 440). San Diego, CA : Academic Press.
53. Tam AP, Murphy KR, Lyall JT 2004). Can changes in differential drop out rates reduce adverse impact? A computer simulation study of a multi-wave selection system. Personnel Psychology, 57, 905 934.
54. Weekley JA, Jones C 1997). Video-based situational testing. Personnel Psychology, 50, 25 49.
55. Whitney DJ, Schmitt N 1997). Relationship between culture and responses to biodata employment items. Journal of Applied Psychology, 82, 113 129.