A theory of adverse impact

Adverse Impact: Implications for Organizational Staffing and High Stakes Selection

Volumn , Issue , 2009, Pages 53-94

  Outtz, James L ^a,b   Newman, Daniel A ^c  

^a AMERICAN PSYCHOLOGICAL ASSOCIATION   (United States)

^b Outtz and Associates   (United States)

^c UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84909595438     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9780203848418     Document Type: Chapter

References (129)

1. Achenbach , T. M. , Howell , C. T. , Aoki , M. F. , & Rauh , V. A. (1993). Nine-year outcome of the Vermont Intervention Program for Low Birth Weight Infants. Pediatrics, 91 , 45-55.
2. Aikens , N. L. , & Barbarin , O. (2008). Socioeconomic differences in reading trajectories: The contribution of family, neighborhood, and school contexts. Journal of Educational Psychology, 100, 235-251.
3. Alderton , D. L. , Wolfe , J. H. , & Larson , G. E. (1997). The ECAT battery. Military Psychology , 9, 5-37.
4. American Psychological Association. (1997). Can-or should-America be color-blind? Psychological research reveals fallacies in a color-blind response to racism [Pamphlet]. Washington, DC: Author.
5. American Sociological Association. (2003). The importance of collecting data and doing social scientific research on race. Washington, DC: Author.
6. Anderson , P. , & Doyle , L. W. (2003). Neurobehavioral outcomes of school-age children born extremely low birth weight or very preterm in the 1990s. JAMA, 289 , 3264-3272.
7. Armstrong , P. I. , Hubert , L. , & Rounds , J. (2003). Circular unidimensional scaling: A new look at group differences in interest structure. Journal of Counseling Psychology , 50, 297-308.
8. Avery , D. R. , & McKay , P. F. (2006). Target practice: An organizational impression management approach to attracting minority and female job applicants. Personnel Psychology , 59 , 157-187.
9. Avery , D. R. , McKay , P. F. , Wilson , D. C. , & Tonidandel , S. (2007). Unequal attendance: The relationships between race, organizational diversity cues, and absenteeism. Personnel Psychology , 60 , 875-902.
10. Bliese , P. D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations (pp. 349-381). San Francisco: Jossey-Bass.
11. Bouchard , J. T. , Jr. , & McGue , M. (1981). Familial studies of intelligence: A review. Science , 212 , 1055-1059.
12. Bradley , R. H. , & Corwyn , R. F. (2002). Socioeconomic Status and Child Development. Annual Review of Psychology , 53, 372-399.
13. Brigham , C. C. (1923). A study of American intelligence. London: Princeton University Press.
14. Brooks-Gunn , J. , & Duncan , G. J. (1997). The Effects of poverty on children. The Future of Children, 7, 55-71.
15. Brown , R. P. , & Day , E. A. (2006). The difference isn't black and white: Stereotype threat and the race gap on Raven's Advanced Progressive Matrices. Journal of Applied Psychology , 91, 979-985.
16. Caldwell , B. M. , & Bradley , R. H. (1984). Home observation for measurement of the environment. Little Rock: University of Arkansas at Little Rock.
17. Campbell , D. T. , & Fiske , D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin , 56, 81-105.
18. Campbell , J. T. , Crooks , L. A. , Mahoney , M. H. , & Rock , D. A. (1973). An investigation of sources of bias in the prediction of job performance: A six-year study. Princeton, NJ: Educational Testing Service.
19. Carroll , J. B. (1993). Human cognitive abilities: A survey of factor-analytic studies. New York: Cambridge University Press.
20. Cattell , R. B. (1971). Abilities: Their structure, growth, and action. Boston: Houghton Mifflin.
21. Ceci , S. J. , & Papierno , P. B. (2005). The rhetoric and reality of gap closing: When the "have-nots" gain but the "haves" gain even more. American Psychologist , 60, 149-160.
22. Chavous , T. M. , Bernat , D. H. , Schmeelk-Cone , K. , Caldwell , C. H. , Kohn-Wood , L. , & Zimmerman , M. A. (2003). Racial identity and academic attainment among African American adolescents. Child Development, 74, 1076-1090.
23. Chipuer , H. M. , Rovine , M. J. , & Plomin , R. (1990). LISREL modeling: Genetic and environmental influences on IQ revisited. Intelligence , 14, 11-29.
24. Cole , N. S. (1973). Bias in selection. Journal of Educational Measurement , 10, 237-255.
25. Colquitt , J. A. , Greenberg , J. , & Zapata-Phelan , C. P. (2005). What is organizational justice? An historical overview. In J. Greenberg and J. A. Colquitt (Eds.), Handbook of organizational justice (pp. 3-56). Mahwah, NJ: Erlbaum.
26. Cropley , A. (2006). In praise of convergent thinking. Creativity Research Journal, 18, 391-404.
27. Darlington , R. B. (1971). Another look at "culture fairness." Journal of Educational Measurement, 8, 71-82.
28. De Corte , W. , Lievens , F. , & Sackett , P. R. (2007). Combining predictors to achieve optimal trade-offs between selection quality and adverse impact. Journal of Applied Psychology , 92, 1380-1393.
29. Dezoete , J. A. , MacArthur , B. A. , & Tuck , B. (2003). Prediction of Bayley and Stanford-Binet scores with a group of very low birthweight children. Child: Care, Health and Development, 29, 367-372.
30. Dickens , W. T. , & Flynn , J. R. (2001). Heritability estimates versus large environmental effects: The IQ paradox resolved. Psychological Review, 108, 346-369.
31. Dickens , W. T. , & Flynn , J. R. (2002). The IQ paradox is still resolved: Reply to Loehlin (2002) and Rowe and Rodgers (2002). Psychological Review , 109, 764-771.
32. Drasgow , Fritz . (2003). Intelligence and the workplace. In W. C. Borman , D. R. Ilgen , and R. J. Klimoski (Eds.), Handbook of psychology: Industrial and organizational psychology (Vol. 12, pp. 107-130). Hoboken, NJ: Wiley.
33. Dusek , J. B. , & Joseph , G. (1983). The bases of teacher expectancies: A meta-analysis. Journal of Educational Psychology, 75, 327-346.
34. Edwards , B. D. , & Arthur , W. (2007). An examination of factors contributing to a reduction in subgroup differences on a constructed-response paper-and-pencil test of scholastic achievement. Journal of Applied Psychology, 92, 794-801.
35. Equal Employment Opportunity Commission. (1978). Uniform Guidelines on Employee Selection Procedures. Washington, DC.
36. Executive Office of the President. (2008, February). Economic Report of the President. Washington, DC: U.S. Government Printing Office.
37. Fagan , J. F. , & Holland , C. R. (2002). Equal opportunity and racial differences in IQ. Intelligence , 30, 361-387.
38. Fagan , J. F. , & Holland , C. R. (2007). Racial equality in intelligence: Predictions from a theory of intelligence as processing. Intelligence , 35, 319-334.
39. Feagin , J. R. (2006). Systemic racism: A theory of oppression. New York: Routledge.
40. Finn , J. D. , & Rock , D. A. (1997). Academic success among students at risk for school failure. Journal of Applied Psychology, 82, 221-234.
41. Flanagan , D. P. , McGrew , K. S. , & Ortiz , S. O. (2000). The Wechsler Intelligence Scales and Gf-Gc theory: A contemporary interpretive approach. Boston: Allyn and Bacon.
42. Fouad , N. A. (2002). Cross-cultural differences in vocational interests: Betweengroups differences in the Strong Interest Inventory. Journal of Counseling Psychology , 49, 283-289.
43. Garth , T. R. (1931). Race psychology: A study of racial mental differences. New York: McGraw-Hill Book Company, Inc.
44. Goslin , D. A. (1963). The search for ability: Standardized testing in social perspective. New York: Russell Sage Foundation.
45. Graves , J. L. , Jr. , & Rose , M. R. (2006). Against racial medicine. Patterns of Prejudice , 40, 481-493.
46. Gross , S. J. , Mettelman , B. B. , Dye , T. D. , & Slagle , T. A. (2001). Impact of family structure and stability on academic outcome in preterm children at 10 years of age. Journal of Pediatrics, 138, 169-175.
47. Guilford , J. P. (1950). Creativity. American Psychologist , 5, 444-454.
48. Guo , G. , & Harris , K. M. (2000). The mechanisms mediating the effects of poverty on children's intellectual development. Demography, 37, 431-447.
49. Hanges , P. J. , & Gettman , H. (2004). A comparison of test-focused and criterionfocused banding methods: Back to the future? In H. Aguinis (Ed.), Test score banding in human resource selection: Legal, technical, and societal issues (pp. 29-48). Westport, CT: Praeger.
50. Harris , M. J. , & Rosenthal , R. (1985). Mediation of interpersonal expectancy effects: 31 Meta-analyses. Psychological Bulletin , 97, 363-386.
51. Hattrup , K. , Rock , J. , & Scalia , C. (1997). The effects of varying conceptualizations of job performance on adverse impact, minority hiring, and predicted performance. Journal of Applied Psychology , 82, 656-664.
52. Helms , J. E. , Jernigan , M. , & Mascher , J. (2005). The meaning of race in psychology and how to change it: A methodological perspective. American Psychologist, 60, 27-36.
53. Horn , J. L. (1991). Measurement of intellectual capabilities: A review of theory. In K. S. McGrew , J. K. Werder , & R. W. Woodcock (Eds.), Woodcock-Johnson technical manual (pp. 197-232). Chicago: Riverside.
54. Hu , L. T. & Bentler , P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling , 6, 1-55.
55. Huffcutt , A. I. , & Arthur , W. , Jr . (1994). Hunter and Hunter (1984) revisited: Interview validity for entry-level jobs. Journal of Applied Psychology , 79, 184-190.
56. Hughes , D. , Rodriguez , J. , Smith , E. P. , Johnson , D. J. , Stevenson , H. C. , & Spicer , P. (2006). Parents' ethnic-racial socializations practices: A review of research and directions for future study. Developmental Psychology, 42, 747-770.
57. Humphreys , L. G. (1984). General intelligence. In C. R. Reynolds & R. T. Brown (Eds.), Perspectives on bias in mental testing (pp. 221-247). New York: Plenum.
58. Hunter , J. E . (1983). The dimensionality of the General Aptitude Test Battery (GATB) and the dominance of general factors over specific factors in the prediction of job performance for the U.S. Employment Services (Report No. USES-TRR-44). Detroit: Michigan State Department of Labor. (ERIC Document Reproduction Service No. ED236166)
59. Hunter , J. E. (1986). Cognitive ability, cognitive aptitudes, job knowledge, and job performance. Journal of Vocational Behavior, 29, 340-362.
60. Hunter , J. E. , Crosson , I. J. , & Friedman , D. H. (1985). The Validity of the Armed Services Vocational Aptitude Battery for civilian and military job performance. Rockville, MD: Research Applications.
61. Hunter , J. E. , & Hunter , R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin , 96, 72-98.
62. Hunter , J. E. , & Schmidt , F. L. (1976). Critical analysis of the statistical and ethical implications of various definitions of test bias. Psychological Bulletin , 83, 1053-1071.
63. Iscoe , I. , & Pierce-Jones , J. (1964). Divergent thinking, age, and intelligence in white and Negro Children. Child Development, 35, 785-797.
64. Ito , T. A. , & Urland , G. R. (2003). Race and gender on the brain: Electrocortical measures of attention to the race and gender of multiply categorizable individuals. Journal of Personality and Social Psychology , 85, 616-626.
65. Johnson , W. , & Bouchard , T. J. , Jr . (2005). The structure of human intelligence: It is verbal, perceptual, and image rotation (VPR), not fluid and crystallized. Intelligence , 33, 393-416
66. Kawakami , K. , Dion , D. L. , & Dovidio , J. F. (1998). Racial prejudice and stereotype activation. Personality and Social Psychology Bulletin , 24, 407-416.
67. Kohlhauser , C. , Fuiko , R. , Panagl , A. , Zadra , C. , Haschke , N. , Brandstetter , S. , et al. (2000). Outcome of very-low-birth-weight-infants at 1 and 2 years of age: The importance of early identification of neurodevelopment deficits. Clinical Pediatrics , 39 (8), 441-449. doi:10.1177/000992280003900801.
68. Kulik , C. C. , & Kulik , J. A. (1982). Effects of ability grouping on secondary school students: A meta-analysis of evaluation findings. American Educational Research Journal, 19, 415-428.
69. Kuncel , N. R. , Hezlett , S. A. , & Ones , D. S. (2004). Academic performance, career potential, creativity, and job performance: Can one construct predict them all? Journal of Personality and Social Psychology , 86, 148-161.
70. Larsen , L. , Hartmann , P. , & Nyborg , H. (2008). The stability of general intelligence from early adulthood to middle-age. Intelligence , 36, 29-34.
71. Le , H. , Oh , I. S. , Shaffer , J. , & Schmidt , F. (2007). Implications of methodological advances for the practice of personnel selection: How practitioners benefit from meta-analysis. Academy of Management Perspectives , 21, 6-15.
72. Lepore , L. , & Brown , R. (1999). Exploring automatic stereotype activation: A challenge to the inevitability of prejudice. In D. Abrams & M. A. Hogg (Eds.), Social identity and social cognition (pp. 141-163). Malden, MA: Blackwell.
73. Lindsey , L. L. , & Beach , S. (2000). Sociology: Social life and social issues. Upper Saddle River, NJ: Prentice Hall.
74. Lipsey , M. W. , & Wilson , D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
75. Macionis , J. J. (1999). Sociology: Student media version. Upper Saddle River, NJ: Prentice Hall.
76. Macrae , C. , & Bodenhausen , G. (2000). Social cognition: Thinking categorically about others. Annual Review of Psychology , 51, 93-120.
77. McGrew , K. S. (1997). Analysis of major intelligence batteries according to a proposed comprehensive Gf-Gc framework. In D. P. Flanagan , J. L. Genshaft , & P. L. Harrison (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (pp. 151-180). New York: Guilford.
78. McGrew , K. S. (2008). CHC theory and the human cognitive abilities project: Standing on the shoulders of the giants of psychometric intelligence research. Intelligence, 37 (1), 1-10. doi: 10.1016/j.intell.2008.08.004.
79. McHenry , J. J. , Hough , L. M. , Toquam , J. L. , Hanson , M. A. , & Ashworth , S. (1990). Project A validity results: The relationship between predictor and criterion domains. Personnel Psychology , 43, 335-354.
80. McIntyre , L. D. , & Pernell , E. (1985). The impact of race on teacher recommendations for special education placement. Journal of Multicultural Counseling and Development, 13, 112-120.
81. McKay , P. F. , & McDaniel , M. A. (2006). A reexamination of black-white mean differences in work performance: More data, more moderators. Journal of Applied Psychology , 91, 538-554.
82. McKay , P. F. , Avery , D. R. , Tonidandel , S. , Morris , M. A. , Hernandez , M. , & Hebl , M. R. (2007). Racial differences in employee retention: Are diversity climate perceptions the key? Personnel Psychology , 60, 35-62.
83. Messick , S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist , 50, 741-749.
84. Murphy , K. R. , Cleveland , J. N. , Skattebo , A. L. , & Kinney , T. B. (2004). Raters who pursue different goals give different ratings. Journal of Applied Psychology , 89, 158-164.
85. Neville , H. A. , Lilly , R. L. , Duran , G. , Lee , R. M. , & Browne , L. (2000). Construction and initial validation of the Color-Blind Racial Attitudes Scale (CoBRAS). Journal of Counseling Psychology , 47, 59-70.
86. Newman , D. A. , Hanges , P. J. , & Outtz , J. L. (2007). Racial groups and test fairness: Considering history and construct validity. American Psychologist , 62, 1082-1083.
87. Newman , D. A. , Jacobs , R. R. , & Bartram , D. (2007). Choosing the best method for local validity estimation: Relative accuracy of meta-analysis vs. a local study vs. Bayes-analysis. Journal of Applied Psychology , 92, 1394-1413.
88. Newman , D. A. , & Lyon , J. S. (2009). Recruitment efforts to reduce adverse impact: Targeted recruiting for personality, cognitive ability, and diversity. Journal of Applied Psychology , 94 (2), 298-317.
89. Oates , G. L. St. C. (2003). Teacher-student racial congruence, teacher perceptions, and test performance. Social Science Quarterly, 84, 508-525.
90. Omi , M. , & Winant , H. (1986). Racial formation in the United States: From the 1960s to the 1980s. New York: Routledge and Kegan Paul.
91. Omi , M. , & Winant , H. (2001). Racial formation. In M. Anderson , K. Logio , & H. Taylor (Eds.), Understanding society (pp. 243-249). Belmont, CA: Wadsworth.
92. Orr , J. M. , Sackett , P. R. , & Mercer , M. (1989). The role of prescribed and nonprescribed behaviors in estimating the dollar value of performance. Journal of Applied Psychology , 74, 34-40.
93. Outtz , J. (1998). Testing medium, validity and test performance. In M. Hakel (Ed.), Beyond multiple choice: Evaluating alternatives to traditional testing for selection (pp. 41-57). Hillsdale, NJ: Erlbaum.
94. Outtz , J. , Goldstein , H. , & Ferreter J. (2006, April). Testing divergent and convergent thinking: Test response format and adverse impact. Paper presented at the 20th Annual Conference of the Society for Industrial and Organizational Psychology, Los Angeles.
95. Petrill , S. A. , Lipton , P. A. , Hewitt , J. K. , Plomin , R. , Cherny , S. S. , Corley , R. , et al. (2004). Genetic and environmental contributions to general cognitive ability through the first 16 years of life. Developmental Psychology , 40, 805-812.
96. Phinney , J. S. (1996). When we talk about American ethnic groups, what do we mean? American Psychologist , 51, 918-927.
97. Ployhart , R. E. , & Holtz , B. C. (2008). The diversity-validity dilemma: Strategies for reducing racioethnic and sex subgroup differences and adverse impact in selection. Personnel Psychology , 61, 153-172.
98. Price-Williams , D. R. , & Ramirez M. (1977). Divergent thinking, cultural differences, and bilingualism. The Journal of Social Psychology, 103, 3-11.
99. Quintana , S. M. (2007). Racial and ethnic identity: Developmental perspectives and research. Journal of Counseling Psychology, 54, 259-270.
100. Ramey , C. T. , & Ramey , S. L. (1998). Prevention of intellectual disabilities: Early interventions to improve cognitive development. Preventive Medicine, 27, 224-232.
101. Roberts , R. D. , Goff , G. N. , Anjoul , F. , Kyllonen , P. C. , Pallier , G. , & Stankov , L. (2000). The Armed Services Vocational Aptitude Battery (ASVAB): Little more than acculturated learning (Gc)!? Learning and Individual Differences , 12, 81-103.
102. Roid , G. H. (2003). Stanford-Binet Intelligence Scale (5th ed.). Itasca, IL: Riverside.
103. Roth , P. L. , Bevier , C. A. , Bobko , P. , Switzer , F. S. , III , & Tyler , P. (2001). Ethnic group differences in cognitive ability in employment and educational settings: A meta-analysis. Personnel Psychology , 54, 297-330.
104. Roth , P. L. , Huffcutt , A. I. , & Bobko , P. (2003). Ethnic group differences in measures of job performance: A new meta-analysis. Journal of Applied Psychology , 88, 694-706.
105. Sackett , P. R. , Schmitt , N. , Ellingson , J. E. , & Kabin , M. B. (2001). High-stakes testing in employment, credentialing, and higher education: Prospects in a postaffirmative action world. American Psychologist , 56, 302-318.
106. Saigal , S. , Szatmari , P. , Rosenbaum , P. , Campbell , D. , & King , S. (1991). Cognitive abilities and school performance of extremely low birth weight children and matched term control children at age 8 years: A regional study. Journal of Pediatrics, 118, 751-760.
107. Schmidt , F. L. , & Hunter , J. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin , 124, 262-274.
108. Schmidt , F. L. , Hunter , J. E. , & Outerbridge , A. N. (1986). Impact of job experience and ability on job knowledge, work sample performance, and supervisory ratings of job performance. Journal of Applied Psychology , 71, 432-439.
109. Schmidt , F. L. , Hunter , J. E. , Outerbridge , A. N. , & Goff , S. (1988). Joint relation of experience and ability with job performance: Test of three hypotheses. Journal of Applied Psychology, 73, 46-57.
110. Schneider , B. (1990). Organizational climate and culture. San Francisco: Jossey-Bass.
111. Sellers , R. M. , Smith , M. A. , Shelton , J. N. , Rowley , S. A. J. , & Chavous , T. M. (1998). Multidimensional model of racial identity: A reconceptualization of African American racial identity. Personality and Social Psychology Review , 2, 18-39.
112. Shuey , A. M. (1958). The testing of Negro intelligence. Lynchburg: VA: Bell.
113. Smedley , A. , & Smedley , B. D. (2005). Race as biology is fiction, racism as a social problem is real: Anthropological and historical perspectives on the social construction of race. American Psychologist, 60, 16-26.
114. Smith , M. L. (1980). Teacher expectations. Evaluation in Education, 4, 53-55.
115. Spearman , C. (1904). "General intelligence," objectively determined and measured. American Journal of Psychology , 15, 201-293.
116. Stangor , S. , Lynch , L. , Duan , C. , & Glass , B. (1992). Categorization of individuals on the basis of multiple social features. Journal of Personality and Social Psychology, 62, 207-218.
117. Stauffer , J. M. , & Buckley , M. R. (2005). The existence and nature of racial bias in supervisory ratings. Journal of Applied Psychology , 90, 586-591.
118. Sternberg , R. J. , Grigorenko , E. L. , & Kidd , K. K. (2005). Intelligence, race, and genetics. American Psychologist , 60, 46-59.
119. Thorndike , E. L. (1939). On the fallacy of imputing the correlations found for groups to the individuals or smaller groups composing them. American Journal of Psychology , 52, 122-124.
120. Torrance , E. P. (1971). Are the Torrance tests of creative thinking biased against or in favor of "disadvantaged" groups? The Gifted Child Quarterly, 15, 75-80.
121. U.S. Bureau of Labor Statistics, & U.S. Census Bureau. (2007). Current population survey. Washington, DC: Author.
122. U.S. Department of Education, National Center for Education Statistics. (2008). The Condition of Education 2008. Washington, DC: Author.
123. U.S. Department of Health and Human Services. (2000). Healthy People 2010 (2nd ed., Vol. 1). Washington, DC: U.S. Government Printing Office.
124. Weisglas-Kuperus , N. , Baerts , W. , Smrkovsky , M. , & Sauer , P. J. (1993). Effects of biological and social factors on the cognitive development of very low birth weight children. Pediatrics, 92, 658-665.
125. White-Clark , R. (2005). Training teachers to succeed in a multicultural climate. Principal, 2, 40-44.
126. Whitley , B. E. , & Kite , M. E. (2006). The psychology of prejudice and discrimination. Belmont, CA: Thomson Higher Education.
127. Wittenbrink , B. , Judd , C. M. , & Park , B. (1997). Evidence for racial prejudice at the implicit level and its relation to questionnaire measures. Journal of Personality and Social Psychology , 72, 262-274.
128. Woodcock , R. W. , McGrew , K. S. , & Mather , N. (2001). Woodcock-Johnson Psychoeducational Battery Third Edition (WJ-3). Chicago: Riverside.
129. Zyphur , M. J. (2006). On the complexity of race. American Psychologist , 61, 179-180.