An analysis of two methods for assessing and indexing adverse impact: A disconnect between the academic literature and some practice

Adverse Impact: Implications for Organizational Staffing and High Stakes Selection

Volumn , Issue , 2009, Pages 29-49

  Bobko, Philip ^a   Roth, Philip L ^b  

^a GETTYSBURG COLLEGE   (United States)

^b CLEMSON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84909630909     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9780203848418     Document Type: Chapter

References (69)

1. Aguinis , H. , & Smith , M. (2007). Understanding the impact of test validity and bias in selection errors and adverse impact in human resource selection. Personnel Psychology , 50 , 165-199.
2. Barrett , R. (1995). Employee selection with the performance priority survey. Personnel Psychology, 48 , 653-662.
3. Barrett , R. (1998). Challenging the myths of fair employment practices. Westport, CT: Quorum.
4. Biddle , D. (2005). Adverse impact and test validation: A practitioner's guide to valid and defensible employment testing. Burlington, VT: Gower.
5. Biddle , R. (1993). How to set cutoff scores for knowledge tests used in promotion, training, certification, and licensing. Public Personnel Management, 22, 63-79.
6. Blank , R. , Dabady , M. , & Citro , C. (2004).Measuring racial discrimination. Washington, DC: National Academies Press.
7. Bobko , P. , & Roth , P. (2004). The four-fifths rule for assessing adverse impact: An arithmetic, intuitive, and logical analysis of the rule and implications for future research. In J. Martocchio (Ed.), Research in personnel and human resources management (Vol. 23, pp. 177-197). New York: Elsevier.
8. Bobko , P. , Roth , P. , & Buster , M. (2005). Work sample selection tests and expected reduction in adverse impact: A cautionary note. International Journal of Selection and Assessment, 13, 1-10.
9. Bobko , P. , Roth , P. , & Potosky , D. (1999). Derivation and implications of a meta-analytic matrix incorporating cognitive ability, alternative predictors and job performance. Personnel Psychology, 52, 561-589.
10. Boardman , A. (1979). Another analysis of the EEOC Four-Fifths Rule. Management Science, 8, 770-776.
11. Buster , M. , Roth , P. , & Bobko , P. (2005). A process for content validation education and experienced-based minimum qualifications: An approach resulting in federal court approval. Personnel Psychology, 58, 771-799.
12. Cascio , W. , Outtz , J. , Zedeck , S. , & Goldstein , I. (1991). Statistical implications of six methods of test score use in personnel selection. Human Performance, 4, 233-264.
13. Cascio , W. , Outtz , J. , Zedeck , S. , & Goldstein , I. (1995). Statistical implications of six methods of test score use in personnel selection. Human Performance, 8 (3), 133-164.
14. DeCorte , W. (1999). Weighing job performance predictors to both maximize the quality of the selected workforce and control the level of adverse impact. Journal of Applied Psychology, 84, 695-702.
15. DeCorte , W. , & Lievens , F. (2003). A practical procedure to estimate the quality and the adverse impact of single-stage selection decisions. International Journal of Selection and Assessment, 11, 89-97.
16. DeCorte , W. , Leivens , F. , & Sackett , P. (2006). Predicting adverse impact and mean criterion performance in multistage selection. Journal of Applied Psychology, 91, 523-537.
17. Doverspike , D. , Winter , J. , Healy , M. , & Barrett , G. (1996). Simulations as a method of illustrating the impact of differential weights on personnel selection outcomes. Human Performance, 9, 259-273.
18. Esson , P. , & Hauenstein , N. (2007, April). Exploring the use of the four-fifths rule and significance tests in adverse impact court case rulings. Paper presented at the annual meetings of the Society for Industrial and Organizational Psychology, New York.
19. Fleiss , J. (1994). Measures of effect size for categorical data. In H. Cooper & L. Hedges (Eds.), The handbook of research synthesis (pp. 245-260). New York: Russell Sage Foundation.
20. Gomez-Mejia , L. , Balkin , D. , & Cardy , R. (2007). Managing human resources (5th ed.). Upper Saddle River, NJ: Pearson/Prentice Hall.
21. Greenberg , I. (1979). An analysis of the EEOC Four-Fifths Rule. Management Science, 8, 762-769.
22. Guion , R. (1998). Assessment, measurement, and prediction for personnel decisions. Mahwah, NJ: Erlbaum.
23. Hattrup , K. , Rock , J. , & Scalia , C. (1997). The effects of varying conceptualizations of job performance on adverse impact, minority hiring, and predicted performance. Journal of Applied Psychology, 82, 656-664.
24. Hazelwood School District v. United States, 433 U.S. 299 (1977).
25. Heneman , H. , & Judge , T. (2006). Staffing organizations (5th ed.). Boston: McGraw-Hill Irwin.
26. Higuera , L. (2001). Adverse impact in personnel selection: The legal framework and test bias. European Psychologist , 6 , 103-111.
27. Hoffman , C. , & Thornton , G. (1997). Examining selection utility where competing predictors differ in adverse impact. Personnel Psychology, 50 , 455-470.
28. Hough , L. , Oswald , F. L. , & Ployhart , R. E. (2001). Determination, detection, and amelioration of adverse impact in personnel selection procedures: Issues, evidence and lessons learned. International Journal of Selection and Assessment , 9 (1&2), 152-194.
29. Hunter , J. , & Hunter , R. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96 , 72-98.
30. Jeanneret , R. (2005). Professional and technical authorities and guidelines. In F. Landy (Ed.), Employment discrimination litigation: Behavioral, quantitative, and legal perspectives (pp. 47-100). San Francisco: Jossey-Bass.
31. Klinger , Y. , & Schuler H. (2004). Improving participants' evaluations while maintaining validity by a work sample-intelligence test hybrid. International Journal of Selection and Assessment , 12 (1/2), 120-134.
32. Lawshe , C. (1987). Adverse impact: Is it a viable concept? Professional Psychology: Research and Practice , 18 , 492-497.
33. Levine , E. , Maye , D. , Ulm , R. , & Gordon , T. (1997). A methodology for developing and validating minimum qualifications (MQs). Personnel Psychology , 50 , 1009-1023.
34. McDaniel , M. , Hartman , N. , Whetzel , D. , & Grubb , W. (2007). Situational judgment tests, response instructions, and validity: A meta-analysis. Personnel Psychology , 60 , 63-91.
35. McKinney , W. , & Collins , J. (1991). The impact on utility, race, and gender using three standard methods of scoring selection examinations. Public Personnel Management, 20 , 145-169.
36. Meier , P. , Sacks , J. , & Zabell , S. (1984). What happened in Hazelwood: Statistics, employment, discrimination and the 80% rule. American Bar Foundation Research Journal, 83 , 139-187.
37. Morris , S. (2001). Sample size required for adverse impact analysis. Applied HRM Research, 1 , 13-32.
38. Morris , S. , & Lobsenz , R. (2000). Significance tests and confidence intervals for the adverse impact ratio. Personnel Psychology, 53 , 89-111.
39. Olian , J. , & Guthrie , J. (1987). Cognitive ability tests in employment: Ethical perspectives of employers and society. Research in Corporate Social Performance and Policy, 9 , 185-213.
40. Olson-Buchanan , J. , Drasgow , F. , Moberg , P. , Mead , A. , Keenan , P. , & Donovan , M. (1998). Interactive video assessment of conflict resolution skills. Personnel Psychology, 51 , 1-24.
41. Ones , D. , & Viswesvaran C. (1998). Gender, age, and race differences on overt integrity tests: Results across four large-scale job applicant data sets. Journal of Applied Psychology , 83 , 35-42.
42. Outtz , J. , & Hanges , P. (2006). Recent practical, methodological, and statistical advances in the detection of adverse impact and test bias. Workshop presented at the 21st annual meeting of the Society for Industrial and Organizational Psychology, May 2006, Dallas, TX.
43. Potosky , D. , Bobko , P. , & Roth , P. (2005). Forming composites of cognitive ability and alternative measures to predict job performance and reduce adverse impact: Corrected estimates and realistic expectations. International Journal of Selection and Assessment , 13 , 304-315.
44. Pulakos , E. (2005). Selection assessment methods. Alexandria, VA: Society for Human Resource Management (SHRM) Foundation.
45. Pulakos , E. , & Schmitt , N. (1996). An evaluation of two strategies for reducing adverse impact and their effects on criterion related validity. Human Performance, 9 , 241-258.
46. Reilly , R. , & Warech , M. (1993). The validity and fairness of alternatives to cognitive ability tests. In L. Wing and B. Gifford (Eds.), Policy issues in employment testing. Boston: Kluwer.
47. Rogelberg , S. (Ed.). (2007). Encyclopedia of industrial and organizational psychology. Thousand Oaks, CA: Sage.
48. Roth , P. , & Bobko , P. (2000). College grades as employment selection mechanisms: Ethnic group differences and adverse impact. Journal of Applied Psychology , 85 , 399-406.
49. Roth , P. , Bobko , P. , & McFarland , L. (2005). A meta-analysis of work sample test validity: Updating and integrating some classic literature. Personnel Psychology , 58 , 1009-1037.
50. Roth , P. , Bobko , P. , & Switzer , F. (2006). Modeling the behavior of the 4/5ths rule for determining adverse impact: Reasons for caution. Journal of Applied Psychology , 91 , 507-522.
51. Roth , P. , Huffcutt , A. , & Bobko , P. (2003). Ethnic group differences in measures of job performance: A new meta-analysis. Journal of Applied Psychology , 88 , 694-706.
52. Roth , P. , Van Iddekinge , C. , Huffcutt , A. , Eidson , C. , & Schmit , M. (2005). Construct research in structured interviews: The case of personality saturation. International Journal of Selection and Assessment , 13 , 261-273.
53. Rothstein , H. , Schmidt , F. , Erwin , F. , Owens , W. , & Sparks , C. (1990). Biographical data in employment selection; Can validities be made generalizable? Journal of Applied Psychology, 75 , 175-184.
54. Ryan , A. , Ployhart , R. , & Friedel , L. (1998). Using personality testing to reduce adverse impact: A cautionary note. Journal of Applied Psychology, 83 , 298-307.
55. Sackett , P. R. , & Ellingson , J. E. (1997). The effects of forming multi-predictor composites on group differences and adverse impact. Personnel Psychology , 50 , 707-721.
56. Salgado , J. , & Moscoso , S. (2002). Comprehensive meta-analysis of the construct validity of the employment interview. European Journal of Work and Organizational Psychology , 11 , 299-324.
57. Schmidt , F. (1996). Statistical significance testing and cumulative knowledge in psychology; implications for training of researchers. Psychological Methods, 1 , 115-129.
58. Schmidt , F. , Gast-Rosenberg , I. , & Hunter , J. (1980). Validity generalization results for computer programmers. Journal of Applied Psychology, 65 , 643-661.
59. Schmidt , F. , & Hunter , J. (1998). The validity of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124 , 262-274.
60. Schmidt , F. , Hunter , J. , & Caplan , J. (1981). Validity generalization results for two job groups in the petroleum industry. Journal of Applied Psychology, 66 , 261-273.
61. Schmitt , N. , Rogers , W. , Chan , D. , Sheppard , L. , & Jennings , D. (1997). Adverse impact and predictive efficiency of various predictor combinations. Journal of Applied Psychology , 82 , 719-730.
62. Siskin , B. , & Trippi , J. (2005). Statistical issues in litigation. In F. Landy (Ed.), Employment discrimination litigation: Behavioral, quantitative, and legal perspectives (pp. 132-167). San Francisco: Jossey-Bass.
63. Sobol , M. , & Ellard , C. (1988). Measures of employment discrimination: A statistical alternative to the four-fifths rule. Industrial Relations Law Journal, 10 , 381-399.
64. Stark , S. , Chernyshenko , O. , & Drasgow , F. (2004). Examining the effects of differential item (functioning and differential) test functioning on selection decisions: When are statistically significant effects practically important? Journal of Applied Psychology, 89 , 497-508.
65. Thornton , G. , Murphy , K. , Everest , T. & Hoffman , C. (2000). Higher cost, lower validity and higher utility: Comparing the utilities of two tests that differ in validity, costs and selectivity. International Journal of Selection and Assessment , 8 (2), 61-75.
66. Tversky , A. , & Kahneman , D. (1971). Belief in the law of small numbers. Psychological Bulletin, 67 , 105-110.
67. U.S. Department of Labor (2007). Federal contract compliance manual . Employment Standards Administration, Office of Federal Contract Compliance Programs. Retrieved May 18, 2007 , from www.dol.gov/esa/regs/compliance/ofccp/ fccm/fccmanul
68. U.S. Equal Opportunity Employment Commission, U.S. Civil Service Commission, U.S. Department of Labor, & U.S. Department of Justice. (1978). Uniform Guidelines on Employee Selection Procedures. Federal Register , 43 , 38295-38309.
69. Weekley , J. , & Jones , C. (1997). Video-based situational testing. Personnel Psychology , 50, 25-49.